Nov 03 16:48:20 devstack cinder-volume[75879]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 16:48:20 devstack cinder-volume[75879]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 16:48:20 devstack cinder-volume[75879]: we strongly recommend against using it for new projects. Nov 03 16:48:20 devstack cinder-volume[75879]: If you are already using Eventlet, we recommend migrating to a different Nov 03 16:48:20 devstack cinder-volume[75879]: framework. For more detail see Nov 03 16:48:20 devstack cinder-volume[75879]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 16:48:20 devstack cinder-volume[75879]: import eventlet # noqa Nov 03 16:48:23 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:48:23 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:48:23 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:48:23 devstack cinder-volume[75879]: INFO dbcounter [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Registered counter for database cinder Nov 03 16:48:23 devstack cinder-volume[75879]: DEBUG oslo_db.sqlalchemy.engines [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:48:24 devstack cinder-volume[75879]: DEBUG dbcounter [-] [75879] Writer thread running {{(pid=75879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:48:24 devstack cinder-volume[75879]: INFO cinder.rpc [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 16:48:24 devstack cinder-volume[75879]: INFO cinder.rpc [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 16:48:24 devstack cinder-volume[75879]: DEBUG oslo_db.sqlalchemy.engines [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:48:24 devstack cinder-volume[75879]: INFO cinder.volume.manager [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Determined volume DB was empty at startup. Nov 03 16:48:24 devstack cinder-volume[75879]: DEBUG cinder.volume.manager [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75879) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 16:48:24 devstack cinder-volume[75879]: INFO cinder.volume.manager [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 16:48:24 devstack cinder-volume[75879]: WARNING stevedore.named [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 16:48:24 devstack cinder-volume[75879]: WARNING castellan.key_manager [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:48:24 devstack cinder-volume[75879]: WARNING cinder.keymgr.conf_key_mgr [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:48:24 devstack cinder-volume[75879]: DEBUG cinder.volume.drivers.lvm [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75879) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 16:48:24 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] CMD "cinder-rtstool verify" returned: 0 in 0.530s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_db.sqlalchemy.engines [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:48:25 devstack cinder-volume[75879]: INFO cinder.rpc [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 16:48:25 devstack cinder-volume[75879]: INFO cinder.rpc [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 16:48:25 devstack cinder-volume[75879]: WARNING stevedore.named [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 16:48:25 devstack cinder-volume[75879]: WARNING castellan.key_manager [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:48:25 devstack cinder-volume[75879]: INFO cinder.volume.manager [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_db.sqlalchemy.engines [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:48:25 devstack cinder-volume[75879]: INFO oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Starting 1 workers Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Started child 76049 {{(pid=75879) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Full set of CONF: {{(pid=75879) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] ******************************************************************************** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Configuration options gathered from: {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] ================================================================================ {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] allow_availability_zone_fallback = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[76049]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] allow_compression_on_image_upload = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] allowed_direct_url_schemes = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] api_rate_limit = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] auth_strategy = keystone {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] az_cache_duration = 3600 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_availability_zone = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_host = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_stats_polling_interval = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backup_api_class = cinder.backup.api.API {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backup_name_template = backup-%s {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backup_use_same_host = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backup_use_temp_snapshot = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] chap_password = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] chap_username = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_internal_tenant_project_id = f83a0a45775846dcb43cda0456db48ab {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_internal_tenant_user_id = d455a85bcd60447c90bb8bf936bbbd64 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cloned_volume_same_az = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cluster = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] compression_format = gzip {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] compute_api_class = cinder.compute.nova.API {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] config_dir = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] config_source = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] control_exchange = openstack {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] debug = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] default_availability_zone = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] default_group_type = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] default_volume_type = lvmdriver-1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] disk_geometry = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] driver_client_cert = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] driver_client_cert_key = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] driver_data_namespace = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] driver_ssl_cert_path = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] driver_ssl_cert_verify = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] driver_use_ssl = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] enable_force_upload = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] enable_new_services = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] enable_unsupported_driver = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] enabled_backends = ['lvmdriver-1'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] enforce_multipath_for_image_xfer = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] filter_function = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_api_insecure = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_api_ssl_compression = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_ca_certificates_file = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_catalog_info = image:glance:publicURL {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_certfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_keyfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_num_retries = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance_request_timeout = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] goodness_function = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] graceful_shutdown_timeout = 5 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] group_api_class = cinder.group.api.API {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] host = devstack {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_compress_on_upload = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_conversion_address_space_limit = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_conversion_cpu_limit = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_conversion_disable = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_introspection_address_space_limit = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_introspection_cpu_limit = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_upload_use_cinder_backend = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_upload_use_internal_tenant = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_volume_cache_enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_volume_cache_max_count = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] image_volume_cache_max_size_gb = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] init_host_max_objects_retrieval = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] instance_format = [instance: %(uuid)s] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] iscsi_target_flags = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] iscsi_write_cache = on {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] iser_helper = tgtadm {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] iser_ip_address = 192.168.122.34 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] iser_port = 3260 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_color = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_config_append = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_dir = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_file = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_options = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_rotate_interval = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_rotate_interval_type = days {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] log_rotation_type = none {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] max_age = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] max_logfile_count = 30 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] max_logfile_size_mb = 200 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] max_over_subscription_ratio = 20.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] message_reap_interval = 86400 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] message_ttl = 2592000 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] migration_create_volume_timeout_secs = 300 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] monkey_patch = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] monkey_patch_modules = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] my_ip = 192.168.122.34 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] no_snapshot_gb_quota = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] num_iser_scan_tries = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] num_shell_tries = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] num_volume_device_scan_tries = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] nvmeof_conn_info_version = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] nvmet_ns_id = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] nvmet_port_id = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] osapi_max_limit = 1000 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] osapi_volume_ext_list = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] osapi_volume_listen = 0.0.0.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] osapi_volume_listen_port = 8776 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] osapi_volume_use_ssl = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] osapi_volume_workers = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] per_volume_size_limit = -1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] periodic_fuzzy_delay = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] periodic_interval = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] project_id_regex = [0-9a-f\-]+ {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] public_endpoint = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] publish_errors = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] quota_backup_gigabytes = 1000 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] quota_backups = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] quota_gigabytes = 1000 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] quota_groups = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] quota_snapshots = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] quota_volumes = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] rate_limit_burst = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] rate_limit_except_level = CRITICAL {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] rate_limit_interval = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] reinit_driver_count = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] replication_device = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] report_discard_supported = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] report_interval = 120 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] reservation_clean_interval = 86400 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] reservation_expire = 86400 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] reserved_image_namespaces = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] reserved_percentage = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] rpc_response_timeout = 120 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] run_external_periodic_tasks = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] scst_target_driver = iscsi {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] scst_target_iqn_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_down_time = 720 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[76049]: INFO cinder.volume.manager [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] shell_completion = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] snapshot_name_template = snapshot-%s {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] snapshot_same_host = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] split_loggers = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] state_path = /opt/stack/data/cinder {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] storage_availability_zone = nova {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] storage_protocol = iSCSI {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] syslog_log_facility = LOG_USER {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] target_helper = lioadm {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] target_ip_address = 192.168.122.34 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] target_port = 3260 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] target_protocol = iscsi {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] target_secondary_ip_addresses = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] trace_flags = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] transfer_api_class = cinder.transfer.api.API {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] transport_url = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] until_refresh = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] use_chap_auth = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] use_default_quota_class = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] use_journal = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] use_json = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] use_multipath_for_image_xfer = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] use_stderr = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] use_syslog = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] verify_glance_signatures = enabled {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_api_class = cinder.volume.api.API {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_backend_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_clear = zero {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_clear_ionice = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_clear_size = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_copy_bps_limit = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_dd_blocksize = 1M {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_name_template = volume-%s {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_service_inithost_offload = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volume_usage_audit_period = month {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] zoning_mode = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_concurrency.disable_process_locking = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.auth_section = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.auth_type = password {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.auth_version = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.cache = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.certfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.include_service_catalog = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.insecure = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.interface = public {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.keyfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_password = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcache_username = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.region_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.service_token_roles_required = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.service_type = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.backend = dogpile.cache.null {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.backend_argument = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.backend_expiration_time = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.config_prefix = cache.oslo {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.debug_cache_backend = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.enable_retry_client = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.enable_socket_keepalive = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.expiration_time = 600 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.hashclient_retry_attempts = 2 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.memcache_dead_retry = 300 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.memcache_pool_maxsize = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.memcache_sasl_enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.password = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.proxies = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.redis_db = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.redis_server = localhost:6379 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.retry_attempts = 2 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.retry_delay = 0.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.socket_keepalive_count = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.socket_keepalive_idle = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.socket_keepalive_interval = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.socket_timeout = 1.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.tls_allowed_ciphers = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.tls_cafile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.tls_certfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.tls_enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.tls_keyfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cache.username = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] coordination.backend_url = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.asyncio_connection = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.asyncio_slave_connection = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.backend = sqlalchemy {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.connection = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.connection_debug = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.connection_parameters = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.connection_recycle_time = 3600 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.connection_trace = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.db_inc_retry_interval = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.db_max_retries = 20 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.db_max_retry_interval = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.db_retry_interval = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.max_overflow = 50 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.max_pool_size = 5 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.max_retries = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.mysql_wsrep_sync_wait = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.pool_timeout = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.retry_interval = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.slave_connection = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.sqlite_synchronous = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.synchronous_reader = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] database.use_db_reconnect = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_tracing.insecure = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.connection_string = messaging:// {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.es_doc_type = notification {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.es_scroll_size = 10000 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.es_scroll_time = 2m {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.filter_error_trace = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.hmac_keys = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.sentinel_service_name = mymaster {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.socket_timeout = 0.1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.trace_requests = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler.trace_sqlalchemy = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler_jaeger.process_tags = {} {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler_jaeger.service_name_prefix = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] profiler_otlp.service_name_prefix = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.enforce_new_defaults = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.policy_default_rule = default {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.policy_file = policy.yaml {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_policy.remote_timeout = 60.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] privsep_osbrick.group = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] privsep_osbrick.helper_command = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] privsep_osbrick.user = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_sys_admin.group = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_sys_admin.helper_command = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] cinder_sys_admin.user = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.auth_section = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.auth_type = password {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.cafile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.certfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.collect_timing = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.insecure = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.keyfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.send_service_user_token = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.split_loggers = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.timeout = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.tls_ciphers = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] service_user.tls_min_version = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.auth_section = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.auth_type = password {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.certfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.collect_timing = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.insecure = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.keyfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.region_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.split_loggers = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.timeout = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.tls_ciphers = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] glance.tls_min_version = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.backend_availability_zone = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.chap_password = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.chap_username = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.disk_geometry = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.driver_client_cert = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.driver_client_cert_key = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.driver_data_namespace = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.driver_use_ssl = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.extra_capabilities = {} {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.filter_function = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.goodness_function = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.iscsi_target_flags = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.iscsi_write_cache = on {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.iser_helper = tgtadm {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.iser_port = 3260 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.lvm_mirrors = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.lvm_share_target = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.lvm_type = auto {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.num_shell_tries = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.replication_device = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.report_discard_supported = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.reserved_percentage = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.target_helper = tgtadm {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.target_port = 3260 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.target_protocol = iscsi {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.trace_flags = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.unique_fqdn_network = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.use_chap_auth = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_backend_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_clear = zero {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_clear_ionice = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_clear_size = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volume_group = cinder-volumes {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_reports.file_event_handler = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_reports.log_dir = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.backend_host = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.chap_password = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.chap_username = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.chiscsi_conf = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.disk_geometry = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.driver_client_cert = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.driver_use_ssl = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.extra_capabilities = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.filter_function = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.goodness_function = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.iser_helper = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.iser_ip_address = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack sudo[76055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 16:48:25 devstack sudo[76055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.iser_port = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.lvm_conf_file = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.lvm_mirrors = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.lvm_share_target = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.lvm_type = auto {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.num_shell_tries = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.nvmet_port_id = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.replication_device = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.report_discard_supported = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.reserved_percentage = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.scst_target_driver = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.storage_protocol = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.target_helper = lioadm {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.target_ip_address = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.target_port = 3260 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.target_protocol = iscsi {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.trace_flags = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.use_chap_auth = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_clear = zero {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_clear_size = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] lvmdriver-1.volumes_dir = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.ssl = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.ssl_version = {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_notifications.driver = [] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_notifications.retry = -1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] key_manager.fixed_key = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.barbican_api_version = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.barbican_endpoint = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.barbican_endpoint_type = public {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.barbican_region_name = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.cafile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.certfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.collect_timing = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.insecure = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.keyfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.number_of_retries = 60 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.retry_delay = 1 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.send_service_user_token = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.split_loggers = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.timeout = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.tls_ciphers = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.tls_min_version = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.verify_ssl = True {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican.verify_ssl_path = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.auth_section = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.auth_type = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.cafile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.certfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.collect_timing = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.insecure = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.keyfile = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.split_loggers = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.timeout = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.tls_ciphers = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] barbican_service_user.tls_min_version = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.approle_role_id = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.approle_secret_id = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.auth_method = approle {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.auth_path = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.kv_mountpoint = secret {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.kv_path = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.kv_version = 2 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.namespace = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.root_token_id = **** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.ssl_ca_crt_file = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.timeout = 60.0 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.token_file = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.token_role = None {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.use_ssl = False {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:48:25 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] ******************************************************************************** {{(pid=75879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 16:48:25 devstack sudo[76055]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:25 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:25 devstack sudo[76058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:25 devstack sudo[76058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:26 devstack sudo[76058]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.294s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 16:48:26 devstack cinder-volume[76049]: INFO cinder.brick.local_dev.lvm [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:26 devstack sudo[76183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:48:26 devstack sudo[76183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:26 devstack sudo[76183]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG cinder.brick.local_dev.lvm [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76049) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:26 devstack sudo[76285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:26 devstack sudo[76285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:26 devstack sudo[76285]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.562s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:26 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:26 devstack sudo[76486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:26 devstack sudo[76486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:27 devstack sudo[76486]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:27 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:27 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:27 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:27 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:27 devstack sudo[76573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 16:48:27 devstack sudo[76573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:27 devstack sudo[76573]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:27 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.415s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:27 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:27 devstack sudo[76669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:48:27 devstack sudo[76669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:27 devstack sudo[76669]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:27 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:27 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:27 devstack sudo[76675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:48:27 devstack sudo[76675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:28 devstack sudo[76675]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:28 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:28 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:28 devstack sudo[76756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:48:28 devstack sudo[76756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:28 devstack sudo[76756]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:28 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:28 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:28 devstack sudo[76766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:28 devstack sudo[76766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:28 devstack sudo[76766]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:28 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.324s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:28 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:28 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:28 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:28 devstack sudo[76850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:28 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:29 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:29 devstack cinder-volume[76049]: INFO cinder.volume.drivers.lvm [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:29 devstack sudo[76854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:29 devstack sudo[76854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:29 devstack sudo[76854]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG cinder.volume.drivers.lvm [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Updating volume stats {{(pid=76049) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:29 devstack sudo[76857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:48:29 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:29 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:29 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:48:29 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:29 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:29 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:29 devstack sudo[76869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:29 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:30 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:30 devstack sudo[76872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:48:30 devstack sudo[76872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:30 devstack sudo[76872]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:30 devstack cinder-volume[76049]: INFO cinder.volume.driver [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG cinder.volume.driver [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76049) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG oslo_db.sqlalchemy.engines [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76049) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG dbcounter [-] [76049] Writer thread running {{(pid=76049) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG cinder.db.api [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Building query based on filter {{(pid=76049) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG cinder.image.image_utils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76049) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 16:48:30 devstack cinder-volume[76049]: INFO cinder.keymgr.migration [None req-59466631-8fbe-49b8-a172-3100cc6d3325 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG cinder.volume.drivers.lvm [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Updating volume stats {{(pid=76049) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:30 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:48:30 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:30 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:30 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:30 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:48:30 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:31 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:31 devstack sudo[76883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:31 devstack sudo[76883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:31 devstack sudo[76883]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:31 devstack sudo[76886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:48:31 devstack sudo[76886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:31 devstack sudo[76886]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG cinder.manager [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Notifying Schedulers of capabilities ... {{(pid=76049) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:48:31 devstack cinder-volume[76049]: INFO cinder.volume.manager [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Driver initialization completed successfully. Nov 03 16:48:31 devstack cinder-volume[76049]: INFO cinder.manager [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Initiating service 2 cleanup Nov 03 16:48:31 devstack cinder-volume[76049]: INFO cinder.manager [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Service 2 cleanup completed. Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG cinder.service [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Creating RPC server for service cinder-volume {{(pid=76049) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG cinder.service [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76049) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 16:48:31 devstack cinder-volume[76049]: INFO cinder.volume.manager [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG cinder.volume.drivers.lvm [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Updating volume stats {{(pid=76049) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:48:31 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:31 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:48:31 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:32 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:32 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:32 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:32 devstack sudo[76893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:48:32 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:32 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:32 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:32 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:32 devstack sudo[76897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:48:32 devstack sudo[76897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:32 devstack sudo[76897]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:32 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:32 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:48:32 devstack sudo[76901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:48:32 devstack sudo[76901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:48:33 devstack sudo[76901]: pam_unix(sudo:session): session closed for user root Nov 03 16:48:33 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:48:33 devstack cinder-volume[76049]: INFO cinder.volume.manager [None req-cc529451-da31-4188-954c-5f0dda7130c4 None None] Driver post RPC initialization completed successfully. Nov 03 16:48:35 devstack cinder-volume[75879]: DEBUG dbcounter [-] [75879] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:48:43 devstack cinder-volume[76049]: DEBUG dbcounter [-] [76049] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76049) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:48:43 devstack cinder-volume[76049]: DEBUG dbcounter [-] [76049] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76049) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:48:58 devstack cinder-volume[76049]: DEBUG oslo_service.periodic_task [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running periodic task VolumeManager._thread_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:48:58 devstack cinder-volume[76049]: DEBUG cinder.volume.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] thread count: 6 {{(pid=76049) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:48:58 devstack cinder-volume[76049]: DEBUG cinder.volume.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] thread info: [<_MainThread(MainThread, started 133297717633152)>, , , , , ] {{(pid=76049) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG oslo_service.periodic_task [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG cinder.volume.drivers.lvm [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Updating volume stats {{(pid=76049) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:49:58 devstack sudo[79481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:49:58 devstack sudo[79481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:49:58 devstack sudo[79481]: pam_unix(sudo:session): session closed for user root Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:49:58 devstack sudo[79541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:49:58 devstack sudo[79541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:49:58 devstack sudo[79541]: pam_unix(sudo:session): session closed for user root Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:49:58 devstack sudo[79795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:49:58 devstack sudo[79795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:49:58 devstack sudo[79795]: pam_unix(sudo:session): session closed for user root Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:49:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:49:58 devstack sudo[79976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:49:58 devstack sudo[79976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:49:59 devstack sudo[79976]: pam_unix(sudo:session): session closed for user root Nov 03 16:49:59 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:49:59 devstack cinder-volume[76049]: DEBUG cinder.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Notifying Schedulers of capabilities ... {{(pid=76049) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:49:59 devstack cinder-volume[76049]: DEBUG oslo_service.periodic_task [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running periodic task VolumeManager._thread_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:49:59 devstack cinder-volume[76049]: DEBUG cinder.volume.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] thread count: 6 {{(pid=76049) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:49:59 devstack cinder-volume[76049]: DEBUG cinder.volume.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] thread info: [<_MainThread(MainThread, started 133297717633152)>, , , , , ] {{(pid=76049) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:50:43 devstack cinder-volume[76049]: DEBUG dbcounter [-] [76049] Writing DB stats cinder:SELECT=1 {{(pid=76049) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:50:43 devstack cinder-volume[76049]: DEBUG dbcounter [-] [76049] Writing DB stats cinder:UPDATE=1 {{(pid=76049) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG oslo_service.periodic_task [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG cinder.volume.drivers.lvm [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Updating volume stats {{(pid=76049) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:50:58 devstack sudo[83286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:50:58 devstack sudo[83286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:50:58 devstack sudo[83286]: pam_unix(sudo:session): session closed for user root Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:50:58 devstack sudo[83327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:50:58 devstack sudo[83327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:50:58 devstack sudo[83327]: pam_unix(sudo:session): session closed for user root Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:50:58 devstack sudo[83341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:50:58 devstack sudo[83341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:50:58 devstack sudo[83341]: pam_unix(sudo:session): session closed for user root Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:50:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:50:58 devstack sudo[83350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:50:58 devstack sudo[83350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:50:59 devstack sudo[83350]: pam_unix(sudo:session): session closed for user root Nov 03 16:50:59 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:50:59 devstack cinder-volume[76049]: DEBUG cinder.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Notifying Schedulers of capabilities ... {{(pid=76049) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:50:59 devstack cinder-volume[76049]: DEBUG oslo_service.periodic_task [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running periodic task VolumeManager._thread_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:50:59 devstack cinder-volume[76049]: DEBUG cinder.volume.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] thread count: 6 {{(pid=76049) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:50:59 devstack cinder-volume[76049]: DEBUG cinder.volume.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] thread info: [<_MainThread(MainThread, started 133297717633152)>, , , , , ] {{(pid=76049) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG oslo_service.periodic_task [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG cinder.volume.drivers.lvm [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Updating volume stats {{(pid=76049) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:51:58 devstack sudo[84963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:51:58 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:51:58 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:51:58 devstack sudo[84966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:51:58 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:51:58 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:51:58 devstack sudo[84971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:51:58 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:51:58 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:51:58 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:51:58 devstack sudo[84974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:51:58 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:51:59 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root Nov 03 16:51:59 devstack cinder-volume[76049]: DEBUG oslo_concurrency.processutils [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76049) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:51:59 devstack cinder-volume[76049]: DEBUG cinder.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Notifying Schedulers of capabilities ... {{(pid=76049) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:51:59 devstack cinder-volume[76049]: DEBUG oslo_service.periodic_task [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] Running periodic task VolumeManager._thread_info {{(pid=76049) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:51:59 devstack cinder-volume[76049]: DEBUG cinder.volume.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] thread count: 6 {{(pid=76049) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:51:59 devstack cinder-volume[76049]: DEBUG cinder.volume.manager [None req-fd10f843-f841-4a43-8b15-97504664d0f0 None None] thread info: [<_MainThread(MainThread, started 133297717633152)>, , , , , ] {{(pid=76049) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:52:43 devstack cinder-volume[76049]: DEBUG dbcounter [-] [76049] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76049) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:52:53 devstack cinder-volume[75879]: INFO oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Caught SIGTERM, stopping children Nov 03 16:52:53 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Acquiring lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:52:53 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Acquired lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:52:53 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Releasing lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:52:53 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Stop services. {{(pid=75879) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 16:52:53 devstack cinder-volume[75879]: DEBUG oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Killing children. {{(pid=75879) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 16:52:53 devstack cinder-volume[75879]: INFO oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Waiting on 1 children to exit Nov 03 16:52:56 devstack cinder-volume[76049]: DEBUG oslo_concurrency.lockutils [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Acquiring lock "singleton_lock" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:52:56 devstack cinder-volume[76049]: DEBUG oslo_concurrency.lockutils [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Acquired lock "singleton_lock" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:52:56 devstack cinder-volume[76049]: DEBUG oslo_concurrency.lockutils [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Releasing lock "singleton_lock" {{(pid=76049) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:52:56 devstack cinder-volume[76049]: WARNING amqp [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 16:52:56 devstack cinder-volume[76049]: WARNING amqp [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 16:52:56 devstack cinder-volume[75879]: INFO oslo_service.backend._eventlet.service [None req-b85c0471-fd70-4f50-975a-9038d43c006c None None] Child 76049 exited with status 0 Nov 03 16:52:57 devstack cinder-volume[86109]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 16:52:57 devstack cinder-volume[86109]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 16:52:57 devstack cinder-volume[86109]: we strongly recommend against using it for new projects. Nov 03 16:52:57 devstack cinder-volume[86109]: If you are already using Eventlet, we recommend migrating to a different Nov 03 16:52:57 devstack cinder-volume[86109]: framework. For more detail see Nov 03 16:52:57 devstack cinder-volume[86109]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 16:52:57 devstack cinder-volume[86109]: import eventlet # noqa Nov 03 16:52:59 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:52:59 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:52:59 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:53:00 devstack cinder-volume[86109]: INFO dbcounter [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Registered counter for database cinder Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_db.sqlalchemy.engines [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG dbcounter [-] [86109] Writer thread running {{(pid=86109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:53:00 devstack cinder-volume[86109]: INFO cinder.rpc [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 16:53:00 devstack cinder-volume[86109]: INFO cinder.rpc [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_db.sqlalchemy.engines [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:53:00 devstack cinder-volume[86109]: INFO cinder.volume.manager [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Determined volume DB was empty at startup. Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG cinder.volume.manager [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86109) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 16:53:00 devstack cinder-volume[86109]: INFO cinder.volume.manager [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 16:53:00 devstack cinder-volume[86109]: WARNING stevedore.named [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 16:53:00 devstack cinder-volume[86109]: WARNING castellan.key_manager [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:53:00 devstack cinder-volume[86109]: WARNING cinder.keymgr.conf_key_mgr [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:53:00 devstack cinder-volume[86109]: INFO cinder.volume.manager [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_db.sqlalchemy.engines [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:53:00 devstack cinder-volume[86109]: INFO oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Starting 1 workers Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Started child 86325 {{(pid=86109) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Full set of CONF: {{(pid=86109) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] ******************************************************************************** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Configuration options gathered from: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 16:53:00 devstack cinder-volume[86325]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] ================================================================================ {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] allow_availability_zone_fallback = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] allow_compression_on_image_upload = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] allowed_direct_url_schemes = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] api_rate_limit = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] auth_strategy = keystone {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_availability_zone = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_host = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_stats_polling_interval = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backup_api_class = cinder.backup.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backup_name_template = backup-%s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backup_use_same_host = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backup_use_temp_snapshot = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] chap_password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] chap_username = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_internal_tenant_project_id = f83a0a45775846dcb43cda0456db48ab {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_internal_tenant_user_id = d455a85bcd60447c90bb8bf936bbbd64 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cluster = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] compression_format = gzip {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] config_dir = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] config_source = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] control_exchange = openstack {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] debug = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] default_availability_zone = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] default_group_type = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] default_volume_type = QuobyteHD {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] disk_geometry = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] driver_client_cert = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] driver_client_cert_key = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] driver_data_namespace = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] driver_ssl_cert_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] driver_ssl_cert_verify = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] driver_use_ssl = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] enable_new_services = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] enable_unsupported_driver = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] enforce_multipath_for_image_xfer = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] filter_function = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_api_insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_api_ssl_compression = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_ca_certificates_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_num_retries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance_request_timeout = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] goodness_function = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] graceful_shutdown_timeout = 5 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] group_api_class = cinder.group.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] host = devstack {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_compress_on_upload = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_conversion_address_space_limit = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_conversion_cpu_limit = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_conversion_disable = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_introspection_address_space_limit = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_introspection_cpu_limit = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_upload_use_cinder_backend = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_upload_use_internal_tenant = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_volume_cache_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_volume_cache_max_count = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] init_host_max_objects_retrieval = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] instance_format = [instance: %(uuid)s] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] iscsi_target_flags = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] iscsi_write_cache = on {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] iser_helper = tgtadm {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] iser_ip_address = 192.168.122.34 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] iser_port = 3260 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_color = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_config_append = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_dir = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_options = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_rotate_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_rotate_interval_type = days {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] log_rotation_type = none {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.remotefs [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86325) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] max_age = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] max_logfile_count = 30 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] max_logfile_size_mb = 200 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] max_over_subscription_ratio = 20.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] message_reap_interval = 86400 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] message_ttl = 2592000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] monkey_patch = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] monkey_patch_modules = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] my_ip = 192.168.122.34 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] no_snapshot_gb_quota = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] num_iser_scan_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] num_shell_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] num_volume_device_scan_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] nvmeof_conn_info_version = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] nvmet_ns_id = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] nvmet_port_id = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] osapi_max_limit = 1000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] osapi_volume_ext_list = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] osapi_volume_listen_port = 8776 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] osapi_volume_use_ssl = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] osapi_volume_workers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] per_volume_size_limit = -1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] periodic_fuzzy_delay = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] periodic_interval = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] public_endpoint = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] publish_errors = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] quota_backup_gigabytes = 1000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] quota_backups = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] quota_gigabytes = 1000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] quota_groups = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] quota_snapshots = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] quota_volumes = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] rate_limit_burst = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] rate_limit_except_level = CRITICAL {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] rate_limit_interval = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] reinit_driver_count = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] replication_device = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] report_discard_supported = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] report_interval = 120 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] reservation_clean_interval = 86400 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] reservation_expire = 86400 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] reserved_image_namespaces = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] reserved_percentage = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] rpc_response_timeout = 120 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] run_external_periodic_tasks = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] scst_target_driver = iscsi {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] scst_target_iqn_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_down_time = 720 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] shell_completion = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] snapshot_name_template = snapshot-%s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] split_loggers = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] state_path = /opt/stack/data/cinder {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] storage_availability_zone = nova {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] storage_protocol = iSCSI {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] syslog_log_facility = LOG_USER {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] target_helper = lioadm {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] target_ip_address = 192.168.122.34 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] target_port = 3260 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] target_protocol = iscsi {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] target_secondary_ip_addresses = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] trace_flags = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] transport_url = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] until_refresh = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] use_chap_auth = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] use_default_quota_class = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] use_journal = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] use_json = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] use_multipath_for_image_xfer = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] use_stderr = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] use_syslog = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] verify_glance_signatures = enabled {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_api_class = cinder.volume.api.API {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_backend_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_clear = zero {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_clear_ionice = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_clear_size = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_copy_bps_limit = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_dd_blocksize = 1M {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_name_template = volume-%s {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_service_inithost_offload = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volume_usage_audit_period = month {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] zoning_mode = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.auth_section = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.auth_type = password {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.auth_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.cache = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.interface = public {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcache_username = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.region_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.service_type = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.backend = dogpile.cache.null {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.backend_argument = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.backend_expiration_time = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.config_prefix = cache.oslo {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.debug_cache_backend = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.enable_retry_client = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.enable_socket_keepalive = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.expiration_time = 600 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.memcache_dead_retry = 300 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.memcache_sasl_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.proxies = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.redis_db = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.redis_server = localhost:6379 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.retry_attempts = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.retry_delay = 0.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.socket_keepalive_count = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.socket_keepalive_idle = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.socket_keepalive_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.socket_timeout = 1.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.tls_allowed_ciphers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.tls_cafile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.tls_certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.tls_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.tls_keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cache.username = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] coordination.backend_url = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.asyncio_connection = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.asyncio_slave_connection = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.backend = sqlalchemy {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.connection = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.connection_debug = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.connection_parameters = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.connection_recycle_time = 3600 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.connection_trace = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.db_inc_retry_interval = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.db_max_retries = 20 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.db_max_retry_interval = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.db_retry_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.max_overflow = 50 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.max_pool_size = 5 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.max_retries = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.pool_timeout = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.retry_interval = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.slave_connection = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.sqlite_synchronous = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.synchronous_reader = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] database.use_db_reconnect = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_tracing.insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.connection_string = messaging:// {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.es_doc_type = notification {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.es_scroll_size = 10000 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.es_scroll_time = 2m {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.filter_error_trace = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:00 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.hmac_keys = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.sentinel_service_name = mymaster {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.socket_timeout = 0.1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.trace_requests = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler.trace_sqlalchemy = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler_jaeger.process_tags = {} {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] profiler_otlp.service_name_prefix = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.policy_default_rule = default {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] privsep_osbrick.group = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] privsep_osbrick.helper_command = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] privsep_osbrick.user = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_sys_admin.group = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_sys_admin.helper_command = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] cinder_sys_admin.user = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.auth_section = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.auth_type = password {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.cafile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.collect_timing = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.send_service_user_token = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.split_loggers = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.timeout = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.tls_ciphers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] service_user.tls_min_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.auth_section = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.auth_type = password {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.collect_timing = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.region_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.split_loggers = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.timeout = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.tls_ciphers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] glance.tls_min_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.backend_availability_zone = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.chap_password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.chap_username = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.disk_geometry = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.driver_client_cert = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.driver_data_namespace = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.driver_use_ssl = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.extra_capabilities = {} {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.filter_function = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.goodness_function = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.iscsi_target_flags = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.iser_port = 3260 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_host = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_login = admin {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_mount_options = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_private_key = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_share_path = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86325) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.replication_device = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.report_discard_supported = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.target_helper = tgtadm {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.target_port = 3260 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.target_protocol = iscsi {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.trace_flags = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.use_chap_auth = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volume_backend_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volume_clear = zero {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86325]: WARNING cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 16:53:01 devstack cinder-volume[86325]: WARNING cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Running cmd (subprocess): mount.quobyte {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_reports.file_event_handler = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_reports.log_dir = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.backend_host = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.chap_password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.chap_username = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.disk_geometry = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.driver_client_cert = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.extra_capabilities = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.filter_function = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.goodness_function = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.iser_helper = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.iser_ip_address = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.iser_port = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_host = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_login = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_mount_options = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_password = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_private_key = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_share_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.num_shell_tries = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.replication_device = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.report_discard_supported = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.reserved_percentage = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.scst_target_driver = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.storage_protocol = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.target_helper = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.target_ip_address = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.target_port = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.target_prefix = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.target_protocol = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.trace_flags = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.use_chap_auth = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volume_clear = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volume_clear_size = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] QuobyteHD.volumes_dir = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_notifications.driver = [] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] key_manager.fixed_key = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack quobyte-client[86329]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.barbican_api_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.barbican_endpoint = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.barbican_endpoint_type = public {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.barbican_region_name = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack quobyte-client[86329]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.cafile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.collect_timing = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.number_of_retries = 60 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.retry_delay = 1 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.send_service_user_token = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.split_loggers = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.timeout = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.tls_ciphers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.tls_min_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.verify_ssl = True {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican.verify_ssl_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.auth_section = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.auth_type = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.cafile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.certfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.collect_timing = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86325]: INFO cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 ... Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.insecure = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.keyfile = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d -c /etc/quobyte/client-cinder.cfg {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.split_loggers = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.timeout = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.tls_ciphers = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] barbican_service_user.tls_min_version = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.approle_role_id = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.approle_secret_id = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.auth_method = approle {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.auth_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.kv_mountpoint = secret {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.kv_path = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.kv_version = 2 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.namespace = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.root_token_id = **** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.ssl_ca_crt_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.timeout = 60.0 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.token_file = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.token_role = None {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.use_ssl = False {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:01 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] ******************************************************************************** {{(pid=86109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 16:53:01 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d -c /etc/quobyte/client-cinder.cfg Nov 03 16:53:01 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:53:01 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.412s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:01 devstack cinder-volume[86325]: INFO cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 succeeded Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.425s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:01 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:53:01 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:53:01 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.240s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:01 devstack cinder-volume[86325]: INFO cinder.volume.driver [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG cinder.volume.driver [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86325) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_db.sqlalchemy.engines [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG dbcounter [-] [86325] Writer thread running {{(pid=86325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG cinder.db.api [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Building query based on filter {{(pid=86325) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG cinder.image.image_utils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86325) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 16:53:01 devstack cinder-volume[86325]: INFO cinder.keymgr.migration [None req-5bf3735b-034e-44ec-924f-73556b3d59c0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:53:01 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:01 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:53:01 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:53:02 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.232s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG cinder.manager [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Notifying Schedulers of capabilities ... {{(pid=86325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:53:02 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Driver initialization completed successfully. Nov 03 16:53:02 devstack cinder-volume[86325]: INFO cinder.manager [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Initiating service 3 cleanup Nov 03 16:53:02 devstack cinder-volume[86325]: INFO cinder.manager [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Service 3 cleanup completed. Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG cinder.service [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Creating RPC server for service cinder-volume {{(pid=86325) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG cinder.service [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86325) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 16:53:02 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:02 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:53:02 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:53:02 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Nov 03 16:53:02 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.274s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:02 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-07c30587-8383-43a2-a487-54cc691427f9 None None] Driver post RPC initialization completed successfully. Nov 03 16:53:06 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-9a154fd2-b5c6-4453-83de-610961be12f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:53:06 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-9a154fd2-b5c6-4453-83de-610961be12f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:53:06 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-9a154fd2-b5c6-4453-83de-610961be12f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:53:06 devstack cinder-volume[86325]: DEBUG cinder.volume.drivers.quobyte [None req-9a154fd2-b5c6-4453-83de-610961be12f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:53:06 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-9a154fd2-b5c6-4453-83de-610961be12f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:53:06 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-9a154fd2-b5c6-4453-83de-610961be12f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:07 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:53:07 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:53:07 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Nov 03 16:53:07 devstack cinder-volume[86325]: DEBUG oslo_concurrency.processutils [None req-9a154fd2-b5c6-4453-83de-610961be12f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.236s {{(pid=86325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:07 devstack cinder-volume[86325]: DEBUG cinder.manager [None req-9a154fd2-b5c6-4453-83de-610961be12f0 None None] Notifying Schedulers of capabilities ... {{(pid=86325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:53:08 devstack cinder-volume[86109]: INFO oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Caught SIGTERM, stopping children Nov 03 16:53:08 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Acquiring lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:53:08 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Acquired lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:53:08 devstack cinder-volume[86109]: DEBUG oslo_concurrency.lockutils [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Releasing lock "singleton_lock" {{(pid=86109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:53:08 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Stop services. {{(pid=86109) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 16:53:08 devstack cinder-volume[86109]: DEBUG oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Killing children. {{(pid=86109) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 16:53:08 devstack cinder-volume[86109]: INFO oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Waiting on 1 children to exit Nov 03 16:53:10 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Acquiring lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:53:10 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Acquired lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:53:10 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Releasing lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:53:10 devstack cinder-volume[86325]: WARNING amqp [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 16:53:10 devstack cinder-volume[86325]: WARNING amqp [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 16:53:10 devstack cinder-volume[86109]: INFO oslo_service.backend._eventlet.service [None req-4eeabc4a-5a38-45dd-b214-4b415fd689d1 None None] Child 86325 exited with status 0 Nov 03 16:53:11 devstack cinder-volume[86643]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 16:53:11 devstack cinder-volume[86643]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 16:53:11 devstack cinder-volume[86643]: we strongly recommend against using it for new projects. Nov 03 16:53:11 devstack cinder-volume[86643]: If you are already using Eventlet, we recommend migrating to a different Nov 03 16:53:11 devstack cinder-volume[86643]: framework. For more detail see Nov 03 16:53:11 devstack cinder-volume[86643]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 16:53:11 devstack cinder-volume[86643]: import eventlet # noqa Nov 03 16:53:14 devstack cinder-volume[86643]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:53:14 devstack cinder-volume[86643]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:53:14 devstack cinder-volume[86643]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:53:15 devstack cinder-volume[86643]: INFO dbcounter [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Registered counter for database cinder Nov 03 16:53:15 devstack cinder-volume[86643]: DEBUG oslo_db.sqlalchemy.engines [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG dbcounter [-] [86643] Writer thread running {{(pid=86643) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:53:16 devstack cinder-volume[86643]: INFO cinder.rpc [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 16:53:16 devstack cinder-volume[86643]: INFO cinder.rpc [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_db.sqlalchemy.engines [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:53:16 devstack cinder-volume[86643]: INFO cinder.volume.manager [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Determined volume DB was empty at startup. Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG cinder.volume.manager [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86643) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 16:53:16 devstack cinder-volume[86643]: WARNING stevedore.named [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 16:53:16 devstack cinder-volume[86643]: WARNING castellan.key_manager [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:53:16 devstack cinder-volume[86643]: WARNING cinder.keymgr.conf_key_mgr [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:53:16 devstack cinder-volume[86643]: INFO cinder.volume.manager [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_db.sqlalchemy.engines [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:53:16 devstack cinder-volume[86643]: INFO oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Starting 1 workers Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Started child 86939 {{(pid=86643) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Full set of CONF: {{(pid=86643) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] ******************************************************************************** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] Configuration options gathered from: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 16:53:16 devstack cinder-volume[86939]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] ================================================================================ {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] allow_availability_zone_fallback = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] allow_compression_on_image_upload = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] allowed_direct_url_schemes = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] api_rate_limit = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] auth_strategy = keystone {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_availability_zone = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_host = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_stats_polling_interval = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backup_api_class = cinder.backup.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backup_name_template = backup-%s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backup_use_same_host = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backup_use_temp_snapshot = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] chap_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] chap_username = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_internal_tenant_project_id = f83a0a45775846dcb43cda0456db48ab {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_internal_tenant_user_id = d455a85bcd60447c90bb8bf936bbbd64 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cluster = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] compression_format = gzip {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] compute_api_class = cinder.compute.nova.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] config_dir = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] config_source = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] control_exchange = openstack {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] debug = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] default_availability_zone = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] default_group_type = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] default_volume_type = QuobyteHD {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] disk_geometry = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] driver_client_cert = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] driver_client_cert_key = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] driver_data_namespace = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] driver_ssl_cert_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] driver_ssl_cert_verify = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] driver_use_ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] enable_new_services = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] enable_unsupported_driver = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] enabled_backends = ['QuobyteHD'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] enforce_multipath_for_image_xfer = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] filter_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_api_insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_api_ssl_compression = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_ca_certificates_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_catalog_info = image:glance:publicURL {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_num_retries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance_request_timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] goodness_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] graceful_shutdown_timeout = 5 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] group_api_class = cinder.group.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] host = devstack {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_compress_on_upload = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_conversion_address_space_limit = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_conversion_cpu_limit = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_conversion_disable = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_introspection_address_space_limit = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_introspection_cpu_limit = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_upload_use_cinder_backend = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_upload_use_internal_tenant = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_volume_cache_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_volume_cache_max_count = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] image_volume_cache_max_size_gb = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] init_host_max_objects_retrieval = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] instance_format = [instance: %(uuid)s] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] iscsi_target_flags = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] iscsi_write_cache = on {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] iser_helper = tgtadm {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] iser_ip_address = 192.168.122.34 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] iser_port = 3260 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_color = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_config_append = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_dir = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86939) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_options = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_rotate_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_rotate_interval_type = days {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] log_rotation_type = none {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] max_age = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] max_logfile_count = 30 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] max_logfile_size_mb = 200 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] max_over_subscription_ratio = 20.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] message_reap_interval = 86400 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] message_ttl = 2592000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] migration_create_volume_timeout_secs = 300 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] monkey_patch = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] monkey_patch_modules = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] my_ip = 192.168.122.34 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] no_snapshot_gb_quota = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] num_iser_scan_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] num_shell_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] num_volume_device_scan_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] nvmeof_conn_info_version = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] nvmet_ns_id = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] nvmet_port_id = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] osapi_max_limit = 1000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] osapi_volume_ext_list = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] osapi_volume_listen_port = 8776 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] osapi_volume_use_ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] osapi_volume_workers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] per_volume_size_limit = -1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] periodic_fuzzy_delay = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] periodic_interval = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] public_endpoint = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] publish_errors = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] quota_backup_gigabytes = 1000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] quota_backups = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] quota_gigabytes = 1000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] quota_groups = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] quota_snapshots = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] quota_volumes = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] rate_limit_burst = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] rate_limit_except_level = CRITICAL {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] rate_limit_interval = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] reinit_driver_count = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] replication_device = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] report_discard_supported = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] report_interval = 120 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] reservation_clean_interval = 86400 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] reservation_expire = 86400 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] reserved_image_namespaces = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] reserved_percentage = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] rpc_response_timeout = 120 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] run_external_periodic_tasks = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] scst_target_driver = iscsi {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] scst_target_iqn_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_down_time = 720 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] shell_completion = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] snapshot_name_template = snapshot-%s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] state_path = /opt/stack/data/cinder {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] storage_availability_zone = nova {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] storage_protocol = iSCSI {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] syslog_log_facility = LOG_USER {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] target_helper = lioadm {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] target_ip_address = 192.168.122.34 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] target_port = 3260 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] target_protocol = iscsi {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] target_secondary_ip_addresses = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] trace_flags = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] transport_url = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] until_refresh = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] use_chap_auth = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] use_default_quota_class = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] use_journal = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] use_json = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] use_multipath_for_image_xfer = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] use_stderr = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] use_syslog = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] verify_glance_signatures = enabled {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_api_class = cinder.volume.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_backend_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_clear = zero {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_clear_ionice = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_clear_size = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_copy_bps_limit = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_dd_blocksize = 1M {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_name_template = volume-%s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_service_inithost_offload = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volume_usage_audit_period = month {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] zoning_mode = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_concurrency.disable_process_locking = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.auth_section = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.auth_type = password {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.auth_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.cache = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.include_service_catalog = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.interface = public {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcache_username = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.region_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.service_type = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.backend = dogpile.cache.null {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.backend_argument = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.backend_expiration_time = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.config_prefix = cache.oslo {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.debug_cache_backend = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.enable_retry_client = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.enable_socket_keepalive = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.expiration_time = 600 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.hashclient_retry_attempts = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.memcache_dead_retry = 300 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.memcache_pool_maxsize = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.memcache_sasl_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.proxies = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.redis_db = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.redis_server = localhost:6379 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.retry_attempts = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.retry_delay = 0.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.socket_keepalive_count = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.socket_keepalive_idle = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.socket_keepalive_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.socket_timeout = 1.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.tls_allowed_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.tls_cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.tls_certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.tls_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.tls_keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cache.username = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] coordination.backend_url = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.asyncio_connection = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.asyncio_slave_connection = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.backend = sqlalchemy {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.connection = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.connection_debug = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.connection_parameters = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.connection_recycle_time = 3600 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.connection_trace = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.db_inc_retry_interval = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.db_max_retries = 20 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.db_max_retry_interval = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.db_retry_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.max_overflow = 50 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.max_pool_size = 5 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.max_retries = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.mysql_wsrep_sync_wait = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.pool_timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.retry_interval = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.slave_connection = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.sqlite_synchronous = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.synchronous_reader = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86939) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] database.use_db_reconnect = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_tracing.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.connection_string = messaging:// {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.es_doc_type = notification {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.es_scroll_size = 10000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.es_scroll_time = 2m {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.filter_error_trace = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.hmac_keys = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.sentinel_service_name = mymaster {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.socket_timeout = 0.1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.trace_requests = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler.trace_sqlalchemy = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler_jaeger.process_tags = {} {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler_jaeger.service_name_prefix = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] profiler_otlp.service_name_prefix = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.enforce_new_defaults = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.policy_default_rule = default {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.policy_file = policy.yaml {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] privsep_osbrick.group = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] privsep_osbrick.helper_command = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] privsep_osbrick.user = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_sys_admin.group = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_sys_admin.helper_command = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] cinder_sys_admin.user = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.auth_section = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.auth_type = password {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.collect_timing = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.send_service_user_token = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.tls_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] service_user.tls_min_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.auth_section = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.auth_type = password {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.collect_timing = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.region_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.tls_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] glance.tls_min_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.backend_availability_zone = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.chap_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.chap_username = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.disk_geometry = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.driver_client_cert = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.driver_client_cert_key = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.driver_data_namespace = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.driver_use_ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.extra_capabilities = {} {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.filter_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.goodness_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.iscsi_target_flags = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.iscsi_write_cache = on {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.iser_helper = tgtadm {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.iser_port = 3260 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_host = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_login = admin {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_mount_options = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_private_key = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_share_path = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.num_shell_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.quobyte_volume_url = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.replication_device = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.report_discard_supported = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.reserved_percentage = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.target_helper = tgtadm {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.target_port = 3260 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.target_protocol = iscsi {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.trace_flags = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.unique_fqdn_network = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.use_chap_auth = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volume_backend_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volume_clear = zero {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volume_clear_ionice = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volume_clear_size = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_reports.file_event_handler = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_reports.log_dir = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.backend_availability_zone = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.backend_host = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.chap_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.chap_username = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.chiscsi_conf = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.disk_geometry = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.driver_client_cert = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.driver_data_namespace = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.driver_use_ssl = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.extra_capabilities = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.filter_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.goodness_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.iser_helper = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.iser_ip_address = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.iser_port = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.iser_target_prefix = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_host = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_login = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_mount_options = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_private_key = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_share_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_ssh_port = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack quobyte-client[86940]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.num_shell_tries = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.nvmet_port_id = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack quobyte-client[86940]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.replication_device = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.report_discard_supported = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.reserved_percentage = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.scst_target_driver = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.storage_protocol = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.target_helper = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.target_ip_address = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.target_port = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.target_prefix = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.target_protocol = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.trace_flags = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.use_chap_auth = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volume_clear = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volume_clear_size = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] QuobyteHD.volumes_dir = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_notifications.driver = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_notifications.retry = -1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] key_manager.fixed_key = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.barbican_api_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.barbican_endpoint = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.barbican_endpoint_type = public {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.barbican_region_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.collect_timing = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.number_of_retries = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.retry_delay = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.send_service_user_token = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.tls_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.tls_min_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.verify_ssl = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican.verify_ssl_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.auth_section = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.auth_type = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.collect_timing = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.tls_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] barbican_service_user.tls_min_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.approle_role_id = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.approle_secret_id = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.auth_method = approle {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.auth_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.kv_mountpoint = secret {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.kv_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.kv_version = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.namespace = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.root_token_id = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.ssl_ca_crt_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.timeout = 60.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.token_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.token_role = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.use_ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:53:16 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-e0730ba2-b961-4d24-85d4-bcbf4278b8f9 None None] ******************************************************************************** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 16:53:17 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.235s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:17 devstack cinder-volume[86939]: INFO cinder.volume.driver [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.volume.driver [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86939) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_db.sqlalchemy.engines [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86939) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writer thread running {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.db.api [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Building query based on filter {{(pid=86939) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86939) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:17 devstack cinder-volume[86939]: INFO cinder.keymgr.migration [None req-3130e672-22f1-45a3-b92b-039b7a291b6f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 16:53:17 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:53:17 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:53:17 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.227s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:53:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Driver initialization completed successfully. Nov 03 16:53:17 devstack cinder-volume[86939]: INFO cinder.manager [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Initiating service 3 cleanup Nov 03 16:53:17 devstack cinder-volume[86939]: INFO cinder.manager [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Service 3 cleanup completed. Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.service [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Creating RPC server for service cinder-volume {{(pid=86939) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.service [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86939) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 16:53:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:53:17 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:53:17 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:53:17 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Nov 03 16:53:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.231s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:53:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-608ec067-b5f3-4d8c-b79c-a4b8ca17c5e2 None None] Driver post RPC initialization completed successfully. Nov 03 16:53:26 devstack cinder-volume[86643]: DEBUG dbcounter [-] [86643] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86643) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:53:27 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:53:27 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:53:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:53:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 6 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:53:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Flow 'volume_create_manager' (56d6c507-01ec-4420-9eec-89ad6bdbb5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f31ebf-ba31-421b-9730-e59d4da51f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f31ebf-ba31-421b-9730-e59d4da51f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1682330999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488cdb64-0dab-4b12-9393-e06f3fe2b5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc187576a811449ebe3a860912a5799e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:17Z,use_quota=True,user_id='ea554f59b53f4609878b709f5aeec63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf5e2c9-cf86-4fcf-ae50-a468f8bdd6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf5e2c9-cf86-4fcf-ae50-a468f8bdd6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31f1634-4e8b-4411-9482-1b91c7230156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31f1634-4e8b-4411-9482-1b91c7230156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488cdb64-0dab-4b12-9393-e06f3fe2b5d2', 'volume_name': 'volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef382382-a608-4af1-bc3a-7f194be65ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef382382-a608-4af1-bc3a-7f194be65ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38df0e8a-54c5-4062-8812-15a181351d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Volume 488cdb64-0dab-4b12-9393-e06f3fe2b5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2', 'volume_size': 1} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1682330999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488cdb64-0dab-4b12-9393-e06f3fe2b5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc187576a811449ebe3a860912a5799e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:17Z,use_quota=True,user_id='ea554f59b53f4609878b709f5aeec63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Creating volume 488cdb64-0dab-4b12-9393-e06f3fe2b5d2 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:54:17 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:54:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:17 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 1073741824 Nov 03 16:54:17 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:18 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 1073741824" returned: 0 in 1.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:18 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 Nov 03 16:54:18 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:19 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2" returned: 0 in 0.482s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:54:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38df0e8a-54c5-4062-8812-15a181351d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7cccd8-3c0d-4cae-9497-c625b8235c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Volume volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 (488cdb64-0dab-4b12-9393-e06f3fe2b5d2): created successfully Nov 03 16:54:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7cccd8-3c0d-4cae-9497-c625b8235c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Flow 'volume_create_manager' (56d6c507-01ec-4420-9eec-89ad6bdbb5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:54:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-99b18b92-6d7a-46aa-8707-a651fba11146 tempest-TaggedAttachmentsTest-949332657 None] Created volume successfully. Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Flow 'volume_create_manager' (3d0ccdfa-604e-4cfe-9645-ed62f684f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f265d9a-9367-47d3-ab3e-bae9a043f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f265d9a-9367-47d3-ab3e-bae9a043f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1093839002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36403c8f-1ec9-49cc-9ea9-45922b19f055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50796ced3a34b1697cf876c58677dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:22Z,use_quota=True,user_id='ca5134548d4c4fa984596af593e07fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfaf135-f2a1-4c03-8304-ccbb54432d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfaf135-f2a1-4c03-8304-ccbb54432d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4779b4e-3984-4e8c-9456-4f97f36472f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4779b4e-3984-4e8c-9456-4f97f36472f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36403c8f-1ec9-49cc-9ea9-45922b19f055', 'volume_name': 'volume-36403c8f-1ec9-49cc-9ea9-45922b19f055', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ac1a76-9e17-47a3-811c-33d23981fd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ac1a76-9e17-47a3-811c-33d23981fd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1cef26-6ab5-4cfc-bf94-96e8e7d66e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:22 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Volume 36403c8f-1ec9-49cc-9ea9-45922b19f055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36403c8f-1ec9-49cc-9ea9-45922b19f055', 'volume_size': 1} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1093839002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36403c8f-1ec9-49cc-9ea9-45922b19f055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50796ced3a34b1697cf876c58677dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:22Z,use_quota=True,user_id='ca5134548d4c4fa984596af593e07fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Creating volume 36403c8f-1ec9-49cc-9ea9-45922b19f055 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:54:22 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:54:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:22 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 1073741824 Nov 03 16:54:22 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:23 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 1073741824" returned: 0 in 0.911s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:23 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 Nov 03 16:54:23 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:24 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055" returned: 0 in 0.646s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:54:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1cef26-6ab5-4cfc-bf94-96e8e7d66e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36403c8f-1ec9-49cc-9ea9-45922b19f055', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e091c066-5d2f-42a2-ac36-e7df38c49e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:24 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Volume volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 (36403c8f-1ec9-49cc-9ea9-45922b19f055): created successfully Nov 03 16:54:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e091c066-5d2f-42a2-ac36-e7df38c49e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Flow 'volume_create_manager' (3d0ccdfa-604e-4cfe-9645-ed62f684f643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:54:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e6e419d1-2bf7-4933-b2a5-e030f9c5601a tempest-DeleteServersTestJSON-796029938 None] Created volume successfully. Nov 03 16:54:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:54:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:54:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:54:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:30 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:54:30 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:31 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.628s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:54:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:54:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 6 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:54:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:54:31 devstack cinder-volume[86939]: WARNING py.warnings [req-43d554da-b0eb-4ffd-b773-ced55e93f466 req-8f925447-8acf-477b-bed9-061561d4631f tempest-DeleteServersTestJSON-796029938 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 03 16:54:31 devstack cinder-volume[86939]: .first() Nov 03 16:54:31 devstack cinder-volume[86939]: Nov 03 16:54:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-43d554da-b0eb-4ffd-b773-ced55e93f466 req-8f925447-8acf-477b-bed9-061561d4631f tempest-DeleteServersTestJSON-796029938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-43d554da-b0eb-4ffd-b773-ced55e93f466 req-8f925447-8acf-477b-bed9-061561d4631f tempest-DeleteServersTestJSON-796029938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-43d554da-b0eb-4ffd-b773-ced55e93f466 req-8f925447-8acf-477b-bed9-061561d4631f tempest-DeleteServersTestJSON-796029938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-43d554da-b0eb-4ffd-b773-ced55e93f466 req-8f925447-8acf-477b-bed9-061561d4631f tempest-DeleteServersTestJSON-796029938 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-36403c8f-1ec9-49cc-9ea9-45922b19f055', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c882f588-84da-4e60-9932-18416b667812', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:54:32 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-43d554da-b0eb-4ffd-b773-ced55e93f466 req-8f925447-8acf-477b-bed9-061561d4631f tempest-DeleteServersTestJSON-796029938 None] attachment_update completed successfully. Nov 03 16:54:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-f0f35f6b-0217-4f6c-8ec8-2857faed8049 req-d396ce11-b844-4d83-82a4-473fef2d3469 tempest-DeleteServersTestJSON-796029938 None] Terminate volume connection completed successfully. Nov 03 16:54:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-f0f35f6b-0217-4f6c-8ec8-2857faed8049 req-d396ce11-b844-4d83-82a4-473fef2d3469 tempest-DeleteServersTestJSON-796029938 None] Deleting attachment c882f588-84da-4e60-9932-18416b667812. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 16:54:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Acquiring lock "cinder-36403c8f-1ec9-49cc-9ea9-45922b19f055-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:54:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Lock "cinder-36403c8f-1ec9-49cc-9ea9-45922b19f055-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:54:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Acquiring lock "cinder-quobyte-36403c8f-1ec9-49cc-9ea9-45922b19f055" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:54:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Lock "cinder-quobyte-36403c8f-1ec9-49cc-9ea9-45922b19f055" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:54:40 devstack cinder-volume[86939]: INFO oslo.privsep.daemon [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgp1s_w5l/privsep.sock'] Nov 03 16:54:40 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgp1s_w5l/privsep.sock Nov 03 16:54:40 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 16:54:41 devstack cinder-volume[86939]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 16:54:42 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:42 devstack cinder-volume[86939]: INFO oslo.privsep.daemon [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Spawned new privsep daemon via rootwrap Nov 03 16:54:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Accepted privsep connection to /tmp/tmpgp1s_w5l/privsep.sock {{(pid=86939) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 16:54:42 devstack cinder-volume[86939]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 16:54:42 devstack cinder-volume[86939]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 16:54:42 devstack cinder-volume[86939]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 16:54:42 devstack cinder-volume[86939]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88698 Nov 03 16:54:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1002a1-2303-44fc-b71e-af87e73c6b9d]: (2,) {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:54:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a74855b-1a9e-4b4c-9557-dfcacfb887c7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:54:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:42 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 Nov 03 16:54:42 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:42 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055" returned: 0 in 0.665s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:42 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055 Nov 03 16:54:42 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:43 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-36403c8f-1ec9-49cc-9ea9-45922b19f055" returned: 0 in 0.345s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Lock "cinder-quobyte-36403c8f-1ec9-49cc-9ea9-45922b19f055" released by "delete_volume" :: held 2.524s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:54:43 devstack cinder-volume[86939]: WARNING cinder.quota [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 16:54:43 devstack cinder-volume[86939]: WARNING cinder.quota [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Created reservations ['a4f14016-9d03-4f6a-8cd0-d159a7e47254', '3526cafd-b026-4c60-b4d4-226d113bfc5c', '1b9eb992-4462-4c30-b0f4-49132fe0f93b', '090adee5-50d7-4b33-8d9c-778a61563e9f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:43 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:54:43 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:43 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.340s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:54:43 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Deleted volume successfully. Nov 03 16:54:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b39f4fef-cf83-454b-aeec-995c8cd35907 tempest-DeleteServersTestJSON-796029938 None] Lock "cinder-36403c8f-1ec9-49cc-9ea9-45922b19f055-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:54:49 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:54:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Flow 'volume_create_manager' (87e405d6-af3b-47ff-8d0b-bfeaa6300902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:54:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95835b5e-bf4d-443b-aa02-4901368b2aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95835b5e-bf4d-443b-aa02-4901368b2aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-383034855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a680c3c-8ac6-480b-ab48-2369b65c6cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494e7226fa1a42e292374c6f969da654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:50Z,use_quota=True,user_id='1cf6084b7bf4424e85a90e956ed96e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a38639-c606-4435-bd46-83df4c97b671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a38639-c606-4435-bd46-83df4c97b671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f33aaf-b469-4d7c-af5c-e91412ba44d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f33aaf-b469-4d7c-af5c-e91412ba44d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a680c3c-8ac6-480b-ab48-2369b65c6cc6', 'volume_name': 'volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0186c79c-a7fe-4f11-9ac8-83a262d24630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0186c79c-a7fe-4f11-9ac8-83a262d24630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6ccb24-7440-44f7-9d65-e48e2d0cdd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:50 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Volume 4a680c3c-8ac6-480b-ab48-2369b65c6cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6', 'volume_size': 1} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-383034855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a680c3c-8ac6-480b-ab48-2369b65c6cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494e7226fa1a42e292374c6f969da654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:54:50Z,use_quota=True,user_id='1cf6084b7bf4424e85a90e956ed96e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Creating volume 4a680c3c-8ac6-480b-ab48-2369b65c6cc6 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:54:50 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:50 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 1073741824 Nov 03 16:54:50 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:50 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 1073741824" returned: 0 in 0.846s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:51 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 Nov 03 16:54:51 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:51 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6" returned: 0 in 0.358s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:54:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:54:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6ccb24-7440-44f7-9d65-e48e2d0cdd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e64a43-b25e-4816-ae39-7a4f8f6387dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:54:51 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Volume volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 (4a680c3c-8ac6-480b-ab48-2369b65c6cc6): created successfully Nov 03 16:54:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e64a43-b25e-4816-ae39-7a4f8f6387dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:54:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Flow 'volume_create_manager' (87e405d6-af3b-47ff-8d0b-bfeaa6300902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:54:51 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-625f6e2c-fa5b-49bb-a02e-5fa050fb9ca3 tempest-ServerActionsTestOtherA-1426664864 None] Created volume successfully. Nov 03 16:55:01 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=19,cinder:SELECT=17,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:55:01 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:55:27 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:55:27 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-631e1d81-0082-4414-93d7-1cc8f0922b92 req-520cf00a-1177-46fa-9cb6-978d93203b92 tempest-TaggedAttachmentsTest-949332657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-631e1d81-0082-4414-93d7-1cc8f0922b92 req-520cf00a-1177-46fa-9cb6-978d93203b92 tempest-TaggedAttachmentsTest-949332657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-631e1d81-0082-4414-93d7-1cc8f0922b92 req-520cf00a-1177-46fa-9cb6-978d93203b92 tempest-TaggedAttachmentsTest-949332657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-631e1d81-0082-4414-93d7-1cc8f0922b92 req-520cf00a-1177-46fa-9cb6-978d93203b92 tempest-TaggedAttachmentsTest-949332657 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5742bd0e-aece-43bf-89aa-8a658c3a0970', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:55:30 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-631e1d81-0082-4414-93d7-1cc8f0922b92 req-520cf00a-1177-46fa-9cb6-978d93203b92 tempest-TaggedAttachmentsTest-949332657 None] attachment_update completed successfully. Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:55:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:30 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:55:30 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:31 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.529s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:55:35 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-c06e1316-1f00-4a82-9120-b259c139008d req-2c7fcf94-8002-4409-93d1-60513e9360b4 tempest-TaggedAttachmentsTest-949332657 None] Terminate volume connection completed successfully. Nov 03 16:55:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-c06e1316-1f00-4a82-9120-b259c139008d req-2c7fcf94-8002-4409-93d1-60513e9360b4 tempest-TaggedAttachmentsTest-949332657 None] Deleting attachment 5742bd0e-aece-43bf-89aa-8a658c3a0970. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 16:55:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-62889006-f33c-47a1-a7c4-d6a79e1c2b80 req-09f75417-1a63-47d2-b9e3-6a46929f3773 tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:55:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-62889006-f33c-47a1-a7c4-d6a79e1c2b80 req-09f75417-1a63-47d2-b9e3-6a46929f3773 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:55:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-62889006-f33c-47a1-a7c4-d6a79e1c2b80 req-09f75417-1a63-47d2-b9e3-6a46929f3773 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:55:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-62889006-f33c-47a1-a7c4-d6a79e1c2b80 req-09f75417-1a63-47d2-b9e3-6a46929f3773 tempest-ServerActionsTestOtherA-1426664864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93b65e6b-f4ef-49c2-94f9-76a96773df97', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:55:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-62889006-f33c-47a1-a7c4-d6a79e1c2b80 req-09f75417-1a63-47d2-b9e3-6a46929f3773 tempest-ServerActionsTestOtherA-1426664864 None] attachment_update completed successfully. Nov 03 16:55:43 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:55:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Flow 'volume_create_manager' (e007f797-7708-4540-a1d6-d3483bc459fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:55:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0fca55-2ab5-43fe-b694-3ececbb9ba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:55:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0fca55-2ab5-43fe-b694-3ececbb9ba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-139703446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4d479bf6a34fedb2606b1c09b09551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:44Z,use_quota=True,user_id='2e9c299ce6524cbf9b712324241aec07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:55:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dad792-800e-467d-b4f7-087f20a72bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:55:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dad792-800e-467d-b4f7-087f20a72bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:55:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73fae02-cf92-426b-ae11-be14e24a0652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73fae02-cf92-426b-ae11-be14e24a0652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c', 'volume_name': 'volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f11373-341d-4067-85d2-94df760bbeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f11373-341d-4067-85d2-94df760bbeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7577eeac-af95-4e10-99c1-313776cb30e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:55:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Volume ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c', 'volume_size': 1} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-139703446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4d479bf6a34fedb2606b1c09b09551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:55:44Z,use_quota=True,user_id='2e9c299ce6524cbf9b712324241aec07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Creating volume ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:55:44 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:55:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:44 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c 1073741824 Nov 03 16:55:44 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:45 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c 1073741824" returned: 0 in 1.057s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:45 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c Nov 03 16:55:45 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-83e70246-7837-4690-baea-f61e03555079 req-3fdc50a3-e0ed-49a7-beba-072688676f17 tempest-ServerActionsTestOtherA-1426664864 None] Terminate volume connection completed successfully. Nov 03 16:55:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-83e70246-7837-4690-baea-f61e03555079 req-3fdc50a3-e0ed-49a7-beba-072688676f17 tempest-ServerActionsTestOtherA-1426664864 None] Deleting attachment 93b65e6b-f4ef-49c2-94f9-76a96773df97. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 16:55:45 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c" returned: 0 in 0.674s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:55:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:55:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7577eeac-af95-4e10-99c1-313776cb30e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:55:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cf67eb-271e-4bfd-9ddc-5191bddde0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:55:45 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Volume volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c (ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c): created successfully Nov 03 16:55:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cf67eb-271e-4bfd-9ddc-5191bddde0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:55:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Flow 'volume_create_manager' (e007f797-7708-4540-a1d6-d3483bc459fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:55:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f545d1cf-8681-472b-9e8c-21c2b9d93e67 tempest-ServerRescueNegativeTestJSON-1179119003 None] Created volume successfully. Nov 03 16:55:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-83e70246-7837-4690-baea-f61e03555079 req-b9ac9dd1-fe22-4d41-be5f-5d6eaf9508a1 tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:55:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-83e70246-7837-4690-baea-f61e03555079 req-b9ac9dd1-fe22-4d41-be5f-5d6eaf9508a1 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:55:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-83e70246-7837-4690-baea-f61e03555079 req-b9ac9dd1-fe22-4d41-be5f-5d6eaf9508a1 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:55:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-83e70246-7837-4690-baea-f61e03555079 req-b9ac9dd1-fe22-4d41-be5f-5d6eaf9508a1 tempest-ServerActionsTestOtherA-1426664864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0c670b5-52af-4144-be41-18a79235f962', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:55:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-83e70246-7837-4690-baea-f61e03555079 req-b9ac9dd1-fe22-4d41-be5f-5d6eaf9508a1 tempest-ServerActionsTestOtherA-1426664864 None] attachment_update completed successfully. Nov 03 16:55:57 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:55:57 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=25,cinder:UPDATE=7 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:55:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Acquiring lock "cinder-488cdb64-0dab-4b12-9393-e06f3fe2b5d2-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:55:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Lock "cinder-488cdb64-0dab-4b12-9393-e06f3fe2b5d2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:55:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Acquiring lock "cinder-quobyte-488cdb64-0dab-4b12-9393-e06f3fe2b5d2" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:55:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Lock "cinder-quobyte-488cdb64-0dab-4b12-9393-e06f3fe2b5d2" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:55:57 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc68b666-62de-4daa-bc2c-a80189a24a34]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:55:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:58 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 Nov 03 16:55:58 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:58 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2" returned: 0 in 0.655s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:58 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2 Nov 03 16:55:58 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:59 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-488cdb64-0dab-4b12-9393-e06f3fe2b5d2" returned: 0 in 0.420s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Lock "cinder-quobyte-488cdb64-0dab-4b12-9393-e06f3fe2b5d2" released by "delete_volume" :: held 1.145s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Created reservations ['2d779300-c0bf-492b-8d9c-ac8210a78508', '310673e8-31ed-48ba-aae0-6f145026ed69', '383c3d01-27c9-4352-8fe5-44f14b3f579b', 'f73fcc33-1bfa-439c-8aae-97734d0f1bc7'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:59 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:55:59 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:59 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.383s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:55:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Deleted volume successfully. Nov 03 16:55:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4e44783c-833f-4cb5-bee2-24a41c41b6d9 tempest-TaggedAttachmentsTest-949332657 None] Lock "cinder-488cdb64-0dab-4b12-9393-e06f3fe2b5d2-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:56:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Acquiring lock "cinder-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:56:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "cinder-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:56:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Acquiring lock "cinder-quobyte-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:56:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "cinder-quobyte-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c" acquired by "delete_volume" :: waited 0.066s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:56:05 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[11701e03-ca8e-4530-a0d3-98ecaa381372]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:56:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:06 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c Nov 03 16:56:06 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:06 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c" returned: 0 in 0.914s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:06 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c Nov 03 16:56:06 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:07 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c" returned: 0 in 0.640s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "cinder-quobyte-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c" released by "delete_volume" :: held 1.789s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Created reservations ['39ce65e9-57d7-4e11-a597-3fc5f124341c', 'e0181978-6952-4db4-980c-5b7da9bb8024', '5e8c179e-1c79-47be-9073-c9e7489fb615', '6623b5a7-b7a9-4fd7-991b-09a39f226e48'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:56:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:08 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:56:08 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:08 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.520s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:08 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:56:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Deleted volume successfully. Nov 03 16:56:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-26711172-2a48-4afc-a6a7-a26c3cd80436 tempest-ServerRescueNegativeTestJSON-1179119003 None] Lock "cinder-ce35d9e8-7be7-406f-90c0-cddd9dbe2e5c-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Flow 'volume_create_manager' (bd552584-8171-4fdd-9dc0-99e6ecb544f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a32f125-6dec-47d5-ac79-96e703f451e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a32f125-6dec-47d5-ac79-96e703f451e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-431014663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a73b478-75bd-4b48-a860-eec14def5766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7adc4ad60d46458b2f3c8bfe09166c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:11Z,use_quota=True,user_id='9a274d1c3c96461fb3de64dfec16f79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9907f77-e592-42e4-8302-9d18186bdd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9907f77-e592-42e4-8302-9d18186bdd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4b1df9-23e2-4300-a197-e70c20170185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4b1df9-23e2-4300-a197-e70c20170185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a73b478-75bd-4b48-a860-eec14def5766', 'volume_name': 'volume-9a73b478-75bd-4b48-a860-eec14def5766', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a7b8ff-be4a-4d1f-a8a2-bf8ba7fbadd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a7b8ff-be4a-4d1f-a8a2-bf8ba7fbadd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ff007a-166c-4f46-92e0-6b89bd37db19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:11 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Volume 9a73b478-75bd-4b48-a860-eec14def5766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a73b478-75bd-4b48-a860-eec14def5766', 'volume_size': 1} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-431014663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a73b478-75bd-4b48-a860-eec14def5766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7adc4ad60d46458b2f3c8bfe09166c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:11Z,use_quota=True,user_id='9a274d1c3c96461fb3de64dfec16f79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Creating volume 9a73b478-75bd-4b48-a860-eec14def5766 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:56:11 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:56:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:11 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 1073741824 Nov 03 16:56:11 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:12 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 1073741824" returned: 0 in 1.012s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:12 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 Nov 03 16:56:12 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:13 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766" returned: 0 in 0.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:56:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:56:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ff007a-166c-4f46-92e0-6b89bd37db19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a73b478-75bd-4b48-a860-eec14def5766', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755fe521-479e-4a62-894e-8b240dea8aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:13 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Volume volume-9a73b478-75bd-4b48-a860-eec14def5766 (9a73b478-75bd-4b48-a860-eec14def5766): created successfully Nov 03 16:56:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755fe521-479e-4a62-894e-8b240dea8aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Flow 'volume_create_manager' (bd552584-8171-4fdd-9dc0-99e6ecb544f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:56:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b477f8b9-465b-4853-a2d0-fc27df661747 tempest-VolumesAdminNegativeTest-572353252 None] Created volume successfully. Nov 03 16:56:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Acquiring lock "cinder-9a73b478-75bd-4b48-a860-eec14def5766-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:56:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Lock "cinder-9a73b478-75bd-4b48-a860-eec14def5766-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:56:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Acquiring lock "cinder-quobyte-9a73b478-75bd-4b48-a860-eec14def5766" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:56:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Lock "cinder-quobyte-9a73b478-75bd-4b48-a860-eec14def5766" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:56:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d90549-0b37-4830-9552-81e233e026c3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:56:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:14 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 Nov 03 16:56:14 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:14 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766" returned: 0 in 0.626s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:15 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766 Nov 03 16:56:15 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:15 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9a73b478-75bd-4b48-a860-eec14def5766" returned: 0 in 0.451s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Lock "cinder-quobyte-9a73b478-75bd-4b48-a860-eec14def5766" released by "delete_volume" :: held 1.133s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Created reservations ['217b1b98-bd52-4ab8-88af-4da00282b580', '14d6f6da-7079-4e7d-8a69-18f7600a7988', 'd9108815-bb07-4c60-948a-b9a2a7ee94ce', 'f9465166-7744-49f0-9852-685e051ba5f1'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:56:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:15 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:56:15 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:16 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.321s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:16 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:56:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Deleted volume successfully. Nov 03 16:56:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f67f5575-0033-4233-bd43-d5a1b18c8d20 tempest-VolumesAdminNegativeTest-572353252 None] Lock "cinder-9a73b478-75bd-4b48-a860-eec14def5766-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:56:25 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=25 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:56:26 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=29,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:56:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:56:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:56:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:56:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:56:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:56:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:56:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:30 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:56:30 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:31 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.243s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:56:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:56:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 8 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:56:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:56:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-570f0395-792c-4744-928e-f4b155479366 req-801ff80c-fc97-465f-8685-e2bdaf825a09 tempest-ServerActionsTestOtherA-1426664864 None] Terminate volume connection completed successfully. Nov 03 16:56:39 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-570f0395-792c-4744-928e-f4b155479366 req-801ff80c-fc97-465f-8685-e2bdaf825a09 tempest-ServerActionsTestOtherA-1426664864 None] Deleting attachment e0c670b5-52af-4144-be41-18a79235f962. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 16:56:49 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=2 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:56:52 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:56:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Flow 'volume_create_manager' (fc4693d3-99f1-4077-88b0-0beac86ac292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:56:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52614802-1bd1-4eb2-b629-04c4084f69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52614802-1bd1-4eb2-b629-04c4084f69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-623612555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969d88dd-8f21-4dd4-a0a5-e97dc06c5d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494e7226fa1a42e292374c6f969da654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:52Z,use_quota=True,user_id='1cf6084b7bf4424e85a90e956ed96e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7695a58c-9b5e-46e9-9501-02de2498d4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7695a58c-9b5e-46e9-9501-02de2498d4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1492ec18-c893-4918-9a15-aef93e4865cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:52 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 16:56:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1492ec18-c893-4918-9a15-aef93e4865cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '969d88dd-8f21-4dd4-a0a5-e97dc06c5d76', 'volume_name': 'volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a574a9-495a-45c8-9528-1de543882c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a574a9-495a-45c8-9528-1de543882c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:56:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366ae700-c6ec-4f0a-b9d5-df9427cead98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:56:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Volume 969d88dd-8f21-4dd4-a0a5-e97dc06c5d76: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 16:56:53 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Trying to clone 969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 from image d3081758-5b01-49fb-b109-4441003b66a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 16:56:54 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 16:56:54 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Image download 20.69 MB at 20.69 MB/s Nov 03 16:56:54 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[575e4507-bc7b-4130-a258-b60ac2a7d77e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:56:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:54 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD Nov 03 16:56:54 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:55 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD" returned: 0 in 1.149s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:55 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 is fetched for user 1cf6084b7bf4424e85a90e956ed96e18. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 16:56:55 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cd2b3d-c16f-4574-9926-8b81ad2362dc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:56:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:55 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD Nov 03 16:56:55 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:56 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-623612555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969d88dd-8f21-4dd4-a0a5-e97dc06c5d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494e7226fa1a42e292374c6f969da654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:56:52Z,use_quota=True,user_id='1cf6084b7bf4424e85a90e956ed96e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Creating volume 969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:56:56 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:56:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:56 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 1073741824 Nov 03 16:56:56 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:57 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 1073741824" returned: 0 in 1.129s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:57 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 Nov 03 16:56:57 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:58 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76" returned: 0 in 0.845s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:56:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:56:58 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Attempting download of d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume 969d88dd-8f21-4dd4-a0a5-e97dc06c5d76. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 16:56:58 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff596892-fe34-4f25-865f-949ab03f04f5]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:56:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_d23kumi7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:59 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_d23kumi7 Nov 03 16:56:59 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:59 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_d23kumi7" returned: 0 in 0.480s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_d23kumi7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:59 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_d23kumi7 Nov 03 16:56:59 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:00 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_d23kumi7" returned: 1 in 0.897s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_d23kumi7' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 16:57:00 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c1cb6-1e22-4d79-9f9c-1b9b5477604b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:57:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:00 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD Nov 03 16:57:00 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:01 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:01 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] d3081758-5b01-49fb-b109-4441003b66a8 was qcow2, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 16:57:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:01 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 Nov 03 16:57:01 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:04 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76" returned: 0 in 2.951s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_i9sz2xuqdevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 16:57:04 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Converted 112.00 MB image at 37.92 MB/s Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:04 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 1G Nov 03 16:57:04 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:04 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 1G" returned: 0 in 0.649s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Downloaded image d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume 969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 for user 1cf6084b7bf4424e85a90e956ed96e18 is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Marking volume 969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Copying metadata from image d3081758-5b01-49fb-b109-4441003b66a8 to 969d88dd-8f21-4dd4-a0a5-e97dc06c5d76. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Creating volume glance metadata for volume 969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 backed by image d3081758-5b01-49fb-b109-4441003b66a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366ae700-c6ec-4f0a-b9d5-df9427cead98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0527bf12-7baf-44bb-8b98-6d466caf6582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:04 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Volume volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 (969d88dd-8f21-4dd4-a0a5-e97dc06c5d76): created successfully Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0527bf12-7baf-44bb-8b98-6d466caf6582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Flow 'volume_create_manager' (fc4693d3-99f1-4077-88b0-0beac86ac292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:04 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-17c6ca6b-389e-4b75-8280-51aec8f98091 tempest-ServerActionsTestOtherA-1426664864 None] Created volume successfully. Nov 03 16:57:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-bd519909-1311-4356-a92b-62b5b15c7788 req-8636b65b-6e2d-42f2-9658-8075c5b82162 tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-bd519909-1311-4356-a92b-62b5b15c7788 req-8636b65b-6e2d-42f2-9658-8075c5b82162 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-bd519909-1311-4356-a92b-62b5b15c7788 req-8636b65b-6e2d-42f2-9658-8075c5b82162 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-bd519909-1311-4356-a92b-62b5b15c7788 req-8636b65b-6e2d-42f2-9658-8075c5b82162 tempest-ServerActionsTestOtherA-1426664864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '163f5aea-30d0-4a36-9d54-a5da152bf0fd', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:57:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-bd519909-1311-4356-a92b-62b5b15c7788 req-8636b65b-6e2d-42f2-9658-8075c5b82162 tempest-ServerActionsTestOtherA-1426664864 None] attachment_update completed successfully. Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Flow 'volume_create_manager' (d47b48f8-5ee7-495f-87b3-d025cda65a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7251cf5f-1133-402d-a24d-2417351a635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7251cf5f-1133-402d-a24d-2417351a635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-271566741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d038547a-af92-4b58-85c3-b895591273fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d89177783164ed79483a9ce2dee44fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:16Z,use_quota=True,user_id='7cb4c896612a497cbbead467e4ba5a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07782ad6-8019-4480-b995-6aa2ffadb7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07782ad6-8019-4480-b995-6aa2ffadb7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13aa2035-d872-4695-9a26-00125c873c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13aa2035-d872-4695-9a26-00125c873c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd038547a-af92-4b58-85c3-b895591273fe', 'volume_name': 'volume-d038547a-af92-4b58-85c3-b895591273fe', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ae1ece-4b7b-482a-b3a2-c276bd9e9b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ae1ece-4b7b-482a-b3a2-c276bd9e9b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1122fe-4891-4a62-b744-d56e16c48fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:16 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Volume d038547a-af92-4b58-85c3-b895591273fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d038547a-af92-4b58-85c3-b895591273fe', 'volume_size': 1} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-271566741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d038547a-af92-4b58-85c3-b895591273fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d89177783164ed79483a9ce2dee44fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:16Z,use_quota=True,user_id='7cb4c896612a497cbbead467e4ba5a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Creating volume d038547a-af92-4b58-85c3-b895591273fe {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:57:16 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:57:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:16 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe 1073741824 Nov 03 16:57:16 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:17 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe 1073741824" returned: 0 in 0.986s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:17 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe Nov 03 16:57:17 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:18 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe" returned: 0 in 0.532s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:57:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1122fe-4891-4a62-b744-d56e16c48fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d038547a-af92-4b58-85c3-b895591273fe', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b49dbbb-fc38-49e6-8c6d-36b1e70f4975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Volume volume-d038547a-af92-4b58-85c3-b895591273fe (d038547a-af92-4b58-85c3-b895591273fe): created successfully Nov 03 16:57:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b49dbbb-fc38-49e6-8c6d-36b1e70f4975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Flow 'volume_create_manager' (d47b48f8-5ee7-495f-87b3-d025cda65a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b2ef86b7-2fb8-42bc-b2ae-490061be5909 tempest-ServersNegativeTestJSON-1545139466 None] Created volume successfully. Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Flow 'volume_create_manager' (b0219cbe-4174-4f51-a7b8-24e98096a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cae9bf2-3a32-48ec-ac6f-16df615d2fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cae9bf2-3a32-48ec-ac6f-16df615d2fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1837647075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7423b40a-68c1-4bd7-89dc-5a5359710b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d89177783164ed79483a9ce2dee44fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:21Z,use_quota=True,user_id='7cb4c896612a497cbbead467e4ba5a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68294f6d-42d1-474c-8d9e-9dbd8d08537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68294f6d-42d1-474c-8d9e-9dbd8d08537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40cc0cb-5fe9-4899-a6cc-263d0a989957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40cc0cb-5fe9-4899-a6cc-263d0a989957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7423b40a-68c1-4bd7-89dc-5a5359710b45', 'volume_name': 'volume-7423b40a-68c1-4bd7-89dc-5a5359710b45', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d06e300-45d8-4ead-9d24-0e7e6ee58bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d06e300-45d8-4ead-9d24-0e7e6ee58bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7664e1-d8c5-4499-b7bd-6ecb8a26d0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:21 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Volume 7423b40a-68c1-4bd7-89dc-5a5359710b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7423b40a-68c1-4bd7-89dc-5a5359710b45', 'volume_size': 1} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1837647075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7423b40a-68c1-4bd7-89dc-5a5359710b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d89177783164ed79483a9ce2dee44fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:21Z,use_quota=True,user_id='7cb4c896612a497cbbead467e4ba5a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Creating volume 7423b40a-68c1-4bd7-89dc-5a5359710b45 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:57:21 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:21 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 1073741824 Nov 03 16:57:21 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:21 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 1073741824" returned: 0 in 0.634s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:22 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 Nov 03 16:57:22 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:22 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45" returned: 0 in 0.629s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:57:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7664e1-d8c5-4499-b7bd-6ecb8a26d0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7423b40a-68c1-4bd7-89dc-5a5359710b45', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c02422-ed8e-4777-b7a6-81edc925bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:22 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Volume volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 (7423b40a-68c1-4bd7-89dc-5a5359710b45): created successfully Nov 03 16:57:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c02422-ed8e-4777-b7a6-81edc925bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Flow 'volume_create_manager' (b0219cbe-4174-4f51-a7b8-24e98096a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-abbb7571-ed45-40ca-a529-d25fe061928b tempest-ServersNegativeTestJSON-1545139466 None] Created volume successfully. Nov 03 16:57:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "cinder-7423b40a-68c1-4bd7-89dc-5a5359710b45-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:57:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Lock "cinder-7423b40a-68c1-4bd7-89dc-5a5359710b45-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:57:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "cinder-quobyte-7423b40a-68c1-4bd7-89dc-5a5359710b45" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:57:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Lock "cinder-quobyte-7423b40a-68c1-4bd7-89dc-5a5359710b45" acquired by "delete_volume" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:57:24 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa4126-ba93-492b-bade-b3b2ecb8f13b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:57:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:24 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 Nov 03 16:57:24 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:25 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45" returned: 0 in 0.691s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:25 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45 Nov 03 16:57:25 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:25 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7423b40a-68c1-4bd7-89dc-5a5359710b45" returned: 0 in 0.377s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Lock "cinder-quobyte-7423b40a-68c1-4bd7-89dc-5a5359710b45" released by "delete_volume" :: held 1.193s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Created reservations ['166e9826-7123-4422-a5c1-f2ecb787f649', '95ebd1cc-f389-4380-ba8c-7d8be9c58571', 'bbd23f8f-7611-4e83-830c-d3faa29943ef', '19494543-d44a-4fef-a203-53c74a6a799a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:25 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:57:25 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "cinder-d038547a-af92-4b58-85c3-b895591273fe-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:57:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Lock "cinder-d038547a-af92-4b58-85c3-b895591273fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:57:26 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 1.101s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:26 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:57:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Deleted volume successfully. Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "cinder-quobyte-d038547a-af92-4b58-85c3-b895591273fe" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Lock "cinder-quobyte-d038547a-af92-4b58-85c3-b895591273fe" acquired by "delete_volume" :: waited 0.070s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Flow 'volume_create_manager' (2160ab0f-5bc0-4909-b517-70a53bad0c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a123f9-1654-4afe-a486-671dcc738830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae091fcd-061a-436b-ae8e-8a2d311e7263]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b02cc455-4333-446e-9b44-688a0786628f tempest-ServersNegativeTestJSON-1545139466 None] Lock "cinder-7423b40a-68c1-4bd7-89dc-5a5359710b45-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a123f9-1654-4afe-a486-671dcc738830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-720601675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7d17a0-532d-46fb-a087-7107682cdb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca0e20e862842c8b6089aefae148df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:27Z,use_quota=True,user_id='2cf1181dbb704c21bd7bc909aeecbdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170e65d7-a137-4dc4-9881-dc3a569f223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170e65d7-a137-4dc4-9881-dc3a569f223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993516a3-c670-4250-9ac5-4f3d53827be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993516a3-c670-4250-9ac5-4f3d53827be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7d17a0-532d-46fb-a087-7107682cdb09', 'volume_name': 'volume-4d7d17a0-532d-46fb-a087-7107682cdb09', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad1fd78-6b67-4cc5-95d9-73c33338c90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad1fd78-6b67-4cc5-95d9-73c33338c90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143b9309-0c23-4c46-abcc-460fa4cff43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:27 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Volume 4d7d17a0-532d-46fb-a087-7107682cdb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7d17a0-532d-46fb-a087-7107682cdb09', 'volume_size': 1} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-720601675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7d17a0-532d-46fb-a087-7107682cdb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca0e20e862842c8b6089aefae148df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:27Z,use_quota=True,user_id='2cf1181dbb704c21bd7bc909aeecbdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Creating volume 4d7d17a0-532d-46fb-a087-7107682cdb09 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:57:27 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:57:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:27 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe Nov 03 16:57:27 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:27 devstack sudo[92594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 1073741824 Nov 03 16:57:27 devstack sudo[92594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:28 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe" returned: 0 in 0.681s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:28 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe Nov 03 16:57:28 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:28 devstack sudo[92594]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 1073741824" returned: 0 in 0.796s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:28 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 Nov 03 16:57:28 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:28 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d038547a-af92-4b58-85c3-b895591273fe" returned: 0 in 0.442s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Lock "cinder-quobyte-d038547a-af92-4b58-85c3-b895591273fe" released by "delete_volume" :: held 1.230s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Created reservations ['26dab8ce-7095-4854-b35d-9a5c42c0aeab', '711d5928-dc3a-4311-97ed-0ce372baea16', '9fa6c08e-5162-4840-ad2e-a74e22efa80d', '36d778a7-08dd-47fd-8bc9-8af5489eeb68'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:28 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09" returned: 0 in 0.483s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:28 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:57:28 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143b9309-0c23-4c46-abcc-460fa4cff43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7d17a0-532d-46fb-a087-7107682cdb09', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cceb396-9f6d-4040-acc4-97b0214fe027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:29 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Volume volume-4d7d17a0-532d-46fb-a087-7107682cdb09 (4d7d17a0-532d-46fb-a087-7107682cdb09): created successfully Nov 03 16:57:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cceb396-9f6d-4040-acc4-97b0214fe027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Flow 'volume_create_manager' (2160ab0f-5bc0-4909-b517-70a53bad0c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3f35e65c-8f95-4b20-b2af-091e85cf8d23 tempest-AttachVolumeShelveTestJSON-1937639774 None] Created volume successfully. Nov 03 16:57:29 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.556s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:29 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:57:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Deleted volume successfully. Nov 03 16:57:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-55cb0aa0-8cdc-4d8d-9eda-1bc1e5f6f82a tempest-ServersNegativeTestJSON-1545139466 None] Lock "cinder-d038547a-af92-4b58-85c3-b895591273fe-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:57:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:57:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:57:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:57:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:30 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:57:30 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:31 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.461s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:57:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:57:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:57:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:57:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-a9c2e09c-0f29-4557-8c62-6acdbdf86142 req-6d7adb36-c090-4dfd-8c0a-cccbd7006747 tempest-ServerActionsTestOtherA-1426664864 None] Terminate volume connection completed successfully. Nov 03 16:57:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-a9c2e09c-0f29-4557-8c62-6acdbdf86142 req-6d7adb36-c090-4dfd-8c0a-cccbd7006747 tempest-ServerActionsTestOtherA-1426664864 None] Deleting attachment 163f5aea-30d0-4a36-9d54-a5da152bf0fd. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 16:57:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-a9c2e09c-0f29-4557-8c62-6acdbdf86142 req-02f7f27c-8785-4f0f-81ee-4a34e6243161 tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-a9c2e09c-0f29-4557-8c62-6acdbdf86142 req-02f7f27c-8785-4f0f-81ee-4a34e6243161 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-a9c2e09c-0f29-4557-8c62-6acdbdf86142 req-02f7f27c-8785-4f0f-81ee-4a34e6243161 tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-a9c2e09c-0f29-4557-8c62-6acdbdf86142 req-02f7f27c-8785-4f0f-81ee-4a34e6243161 tempest-ServerActionsTestOtherA-1426664864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7608e404-247c-43d1-8833-dee751511623', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:57:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-a9c2e09c-0f29-4557-8c62-6acdbdf86142 req-02f7f27c-8785-4f0f-81ee-4a34e6243161 tempest-ServerActionsTestOtherA-1426664864 None] attachment_update completed successfully. Nov 03 16:57:49 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=41,cinder:INSERT=15,cinder:UPDATE=31,cinder:DELETE=4 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:57:49 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=35,cinder:SELECT=39,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:57:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-779d720d-2e7b-46dd-bf77-d6b62fcdd86f req-9306125b-aeaf-450b-bef6-c56a76a3e222 tempest-AttachVolumeShelveTestJSON-1937639774 None] No connector for attachment eff313cd-f422-404f-bd71-815bf21512ca; skipping storage backend terminate_connection call. {{(pid=86939) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 16:57:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-779d720d-2e7b-46dd-bf77-d6b62fcdd86f req-9306125b-aeaf-450b-bef6-c56a76a3e222 tempest-AttachVolumeShelveTestJSON-1937639774 None] Deleting attachment eff313cd-f422-404f-bd71-815bf21512ca. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Flow 'volume_create_manager' (c92f9ce1-e385-4e65-80bf-111fa0e4e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add82bd1-c580-4e3b-969b-8d40eeb53122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add82bd1-c580-4e3b-969b-8d40eeb53122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1636000299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419def39-5df3-4488-99dd-56d0050ee8fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5caaa085625042bf8c02249940dff808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:53Z,use_quota=True,user_id='5c4aca8551134cc08628568e3eec0d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a999e2d0-c70b-4861-a806-63767a973782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a999e2d0-c70b-4861-a806-63767a973782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcb8dfa-a135-4a02-ab41-a6ace8ad1a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcb8dfa-a135-4a02-ab41-a6ace8ad1a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419def39-5df3-4488-99dd-56d0050ee8fc', 'volume_name': 'volume-419def39-5df3-4488-99dd-56d0050ee8fc', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe05055a-f312-4a7f-912a-477c8f02c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe05055a-f312-4a7f-912a-477c8f02c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ff12e7-285a-4747-8f8b-7fd0e679e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Volume 419def39-5df3-4488-99dd-56d0050ee8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419def39-5df3-4488-99dd-56d0050ee8fc', 'volume_size': 1} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1636000299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419def39-5df3-4488-99dd-56d0050ee8fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5caaa085625042bf8c02249940dff808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:57:53Z,use_quota=True,user_id='5c4aca8551134cc08628568e3eec0d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Creating volume 419def39-5df3-4488-99dd-56d0050ee8fc {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:57:53 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:57:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:53 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc 1073741824 Nov 03 16:57:53 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:54 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc 1073741824" returned: 0 in 0.595s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:54 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc Nov 03 16:57:54 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:54 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc" returned: 0 in 0.307s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ff12e7-285a-4747-8f8b-7fd0e679e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419def39-5df3-4488-99dd-56d0050ee8fc', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc847dbc-3d9f-4e1d-a2e7-f83371dc19bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:57:54 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Volume volume-419def39-5df3-4488-99dd-56d0050ee8fc (419def39-5df3-4488-99dd-56d0050ee8fc): created successfully Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc847dbc-3d9f-4e1d-a2e7-f83371dc19bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:57:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Flow 'volume_create_manager' (c92f9ce1-e385-4e65-80bf-111fa0e4e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:57:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-b4943ff1-3670-4819-9f53-bad7df53df83 req-5c7ce131-2895-4863-89a7-d6c2079957d0 tempest-VolumesGetTestJSON-264031419 None] Created volume successfully. Nov 03 16:57:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Acquiring lock "cinder-419def39-5df3-4488-99dd-56d0050ee8fc-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:57:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Lock "cinder-419def39-5df3-4488-99dd-56d0050ee8fc-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:57:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Acquiring lock "cinder-quobyte-419def39-5df3-4488-99dd-56d0050ee8fc" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:57:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Lock "cinder-quobyte-419def39-5df3-4488-99dd-56d0050ee8fc" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:57:55 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[123fcec8-5de5-41d0-97bf-427c0f7829f0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:57:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:56 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc Nov 03 16:57:56 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:56 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc" returned: 0 in 0.641s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:56 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc Nov 03 16:57:56 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:56 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-419def39-5df3-4488-99dd-56d0050ee8fc" returned: 0 in 0.281s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Lock "cinder-quobyte-419def39-5df3-4488-99dd-56d0050ee8fc" released by "delete_volume" :: held 0.993s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:57:56 devstack cinder-volume[86939]: DEBUG cinder.quota [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Created reservations ['3cca418f-efdf-4e2e-90af-22a02dad74a9', 'e87da114-eff4-4779-88ba-7ed003255150', '5f191ef5-040a-427f-87ed-a09bec180a27', '36737481-6387-417a-bc87-ae1e9b431f5c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:57 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:57:57 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:57 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.287s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG cinder.manager [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:57:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Deleted volume successfully. Nov 03 16:57:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-b52e0a51-097e-4f4c-9317-ca6ec88e8673 req-dc8d39df-51f2-4736-b359-f893e0fea1bd tempest-VolumesGetTestJSON-264031419 None] Lock "cinder-419def39-5df3-4488-99dd-56d0050ee8fc-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Flow 'volume_create_manager' (af986e58-6354-465b-b467-ba58a906b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2210bb89-cd33-48e7-9327-ff5c1be7979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2210bb89-cd33-48e7-9327-ff5c1be7979a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1386406273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc660c5-f9f7-44de-a899-7a6587296b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca650579e0324474870c58f4d07fe5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:04Z,use_quota=True,user_id='9bc651b4b4474144973f2dd9fea8a070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d501e667-d3eb-4faa-9ed8-c490cf8b6da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d501e667-d3eb-4faa-9ed8-c490cf8b6da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8520a5dd-4507-4b55-a73f-1f0e656c5a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8520a5dd-4507-4b55-a73f-1f0e656c5a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc660c5-f9f7-44de-a899-7a6587296b41', 'volume_name': 'volume-2cc660c5-f9f7-44de-a899-7a6587296b41', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a808ef-e429-49ac-8cf8-e6ca03200d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a808ef-e429-49ac-8cf8-e6ca03200d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92502f8-f0dc-47db-85a1-956e5137410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:03 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Volume 2cc660c5-f9f7-44de-a899-7a6587296b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc660c5-f9f7-44de-a899-7a6587296b41', 'volume_size': 1} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1386406273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc660c5-f9f7-44de-a899-7a6587296b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca650579e0324474870c58f4d07fe5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:04Z,use_quota=True,user_id='9bc651b4b4474144973f2dd9fea8a070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Creating volume 2cc660c5-f9f7-44de-a899-7a6587296b41 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:58:03 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:58:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:04 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 1073741824 Nov 03 16:58:04 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:04 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 1073741824" returned: 0 in 0.588s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:04 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 Nov 03 16:58:04 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Flow 'volume_create_manager' (74dc409b-8551-4e60-934d-6c471cf7544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843b58de-a3de-46f3-95f8-ea51adb09180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843b58de-a3de-46f3-95f8-ea51adb09180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1241294661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b829fe0c-f95a-434b-9ad1-ff2548e16cd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c2ccc7a6329498cb1c5f165cef179aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:05Z,use_quota=True,user_id='23b4c3192ab143668d0eca1b4aca39c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3346f411-4308-4c4a-b3b1-7ae8c16a111c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3346f411-4308-4c4a-b3b1-7ae8c16a111c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:04 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bcf381-9504-486d-bcbc-ce685b3b4222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bcf381-9504-486d-bcbc-ce685b3b4222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b829fe0c-f95a-434b-9ad1-ff2548e16cd5', 'volume_name': 'volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153e1aa5-244d-4838-b420-79b065373174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153e1aa5-244d-4838-b420-79b065373174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56bffbb-481d-45f2-9c22-7c403120dc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:04 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Volume b829fe0c-f95a-434b-9ad1-ff2548e16cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5', 'volume_size': 1} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41" returned: 0 in 0.341s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1241294661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b829fe0c-f95a-434b-9ad1-ff2548e16cd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c2ccc7a6329498cb1c5f165cef179aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:05Z,use_quota=True,user_id='23b4c3192ab143668d0eca1b4aca39c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Creating volume b829fe0c-f95a-434b-9ad1-ff2548e16cd5 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:58:04 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:58:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92502f8-f0dc-47db-85a1-956e5137410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc660c5-f9f7-44de-a899-7a6587296b41', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603eaa45-37f7-4337-9713-10d663f76d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:05 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 1073741824 Nov 03 16:58:05 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Volume volume-2cc660c5-f9f7-44de-a899-7a6587296b41 (2cc660c5-f9f7-44de-a899-7a6587296b41): created successfully Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603eaa45-37f7-4337-9713-10d663f76d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Flow 'volume_create_manager' (af986e58-6354-465b-b467-ba58a906b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-16f37460-0cf9-4061-9619-cd4839e8da17 tempest-AttachVolumeTestJSON-1054885035 None] Created volume successfully. Nov 03 16:58:05 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 1073741824" returned: 0 in 0.449s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:05 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 Nov 03 16:58:05 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:05 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5" returned: 0 in 0.292s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56bffbb-481d-45f2-9c22-7c403120dc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57be56f5-c92d-456d-a89e-9d5689b8fbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Volume volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 (b829fe0c-f95a-434b-9ad1-ff2548e16cd5): created successfully Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57be56f5-c92d-456d-a89e-9d5689b8fbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Flow 'volume_create_manager' (74dc409b-8551-4e60-934d-6c471cf7544c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6386ff62-7cdf-4f59-970c-2ee9a5dba26c tempest-VolumesTestJSON-91015344 None] Created volume successfully. Nov 03 16:58:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-47db67ac-edbd-4883-a16c-6f190189be53 req-d24ccaa3-71b2-4a67-8b94-268842206dd5 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-47db67ac-edbd-4883-a16c-6f190189be53 req-d24ccaa3-71b2-4a67-8b94-268842206dd5 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-47db67ac-edbd-4883-a16c-6f190189be53 req-d24ccaa3-71b2-4a67-8b94-268842206dd5 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-47db67ac-edbd-4883-a16c-6f190189be53 req-d24ccaa3-71b2-4a67-8b94-268842206dd5 tempest-AttachVolumeTestJSON-1054885035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-2cc660c5-f9f7-44de-a899-7a6587296b41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfa7c367-b128-4034-90df-9541d861852d', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:58:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-47db67ac-edbd-4883-a16c-6f190189be53 req-d24ccaa3-71b2-4a67-8b94-268842206dd5 tempest-AttachVolumeTestJSON-1054885035 None] attachment_update completed successfully. Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Flow 'volume_create_manager' (a907f227-4555-492a-bc25-063dd6e9b572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74623041-0be4-4bb6-82dd-006c9a83a83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74623041-0be4-4bb6-82dd-006c9a83a83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-732963781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a2f0ff-d695-44f4-a796-9e700ac7a9d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c2ccc7a6329498cb1c5f165cef179aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:08Z,use_quota=True,user_id='23b4c3192ab143668d0eca1b4aca39c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc33792-29c4-4479-9e53-2a8e5b929ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc33792-29c4-4479-9e53-2a8e5b929ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad55c896-0a8a-43c8-86d3-fe241112cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad55c896-0a8a-43c8-86d3-fe241112cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a2f0ff-d695-44f4-a796-9e700ac7a9d5', 'volume_name': 'volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3083a99-a5fc-4583-b285-654d86c72e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3083a99-a5fc-4583-b285-654d86c72e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3131cfa8-6b13-4ac4-aa03-be2ab52376fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Volume 57a2f0ff-d695-44f4-a796-9e700ac7a9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5', 'volume_size': 1} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-732963781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a2f0ff-d695-44f4-a796-9e700ac7a9d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c2ccc7a6329498cb1c5f165cef179aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:08Z,use_quota=True,user_id='23b4c3192ab143668d0eca1b4aca39c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Creating volume 57a2f0ff-d695-44f4-a796-9e700ac7a9d5 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:58:07 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:58:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:07 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 1073741824 Nov 03 16:58:07 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:08 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 1073741824" returned: 0 in 0.618s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:08 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 Nov 03 16:58:08 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:08 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5" returned: 0 in 0.318s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3131cfa8-6b13-4ac4-aa03-be2ab52376fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b4ab26-86c3-4cc0-b69c-a53d729008c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:08 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Volume volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 (57a2f0ff-d695-44f4-a796-9e700ac7a9d5): created successfully Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b4ab26-86c3-4cc0-b69c-a53d729008c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Flow 'volume_create_manager' (a907f227-4555-492a-bc25-063dd6e9b572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b565774c-da84-4593-8596-9cfe6f757788 tempest-VolumesTestJSON-91015344 None] Created volume successfully. Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Flow 'volume_create_manager' (03144700-2b0b-4e0f-ba6d-1a92631a4c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ec6a75-80f9-4e53-9160-7e279ab409ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ec6a75-80f9-4e53-9160-7e279ab409ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-587137493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b1662f-18b7-47f4-a2c5-8e676451d0ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c2ccc7a6329498cb1c5f165cef179aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:11Z,use_quota=True,user_id='23b4c3192ab143668d0eca1b4aca39c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a53afe6-9d2a-45ff-9dd3-56fbb59252f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a53afe6-9d2a-45ff-9dd3-56fbb59252f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07b99be-a62b-489e-940f-b837af5add53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07b99be-a62b-489e-940f-b837af5add53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b1662f-18b7-47f4-a2c5-8e676451d0ed', 'volume_name': 'volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12bd410-bbf9-4933-85c3-63be4a7af76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12bd410-bbf9-4933-85c3-63be4a7af76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca22b059-57b7-467e-8d2b-e36ca4283e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Volume 16b1662f-18b7-47f4-a2c5-8e676451d0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed', 'volume_size': 1} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-587137493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b1662f-18b7-47f4-a2c5-8e676451d0ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c2ccc7a6329498cb1c5f165cef179aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:11Z,use_quota=True,user_id='23b4c3192ab143668d0eca1b4aca39c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Creating volume 16b1662f-18b7-47f4-a2c5-8e676451d0ed {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:58:10 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:58:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:11 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed 1073741824 Nov 03 16:58:11 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:11 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed 1073741824" returned: 0 in 0.907s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:11 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed Nov 03 16:58:11 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:12 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed" returned: 0 in 0.405s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:58:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca22b059-57b7-467e-8d2b-e36ca4283e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88f76bb-e46c-4175-b149-f80e75292839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:12 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Volume volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed (16b1662f-18b7-47f4-a2c5-8e676451d0ed): created successfully Nov 03 16:58:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88f76bb-e46c-4175-b149-f80e75292839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Flow 'volume_create_manager' (03144700-2b0b-4e0f-ba6d-1a92631a4c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:12 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5be0e106-72e9-4be7-9615-ba99eb3dc365 tempest-VolumesTestJSON-91015344 None] Created volume successfully. Nov 03 16:58:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Acquiring lock "cinder-16b1662f-18b7-47f4-a2c5-8e676451d0ed-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Lock "cinder-16b1662f-18b7-47f4-a2c5-8e676451d0ed-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Acquiring lock "cinder-quobyte-16b1662f-18b7-47f4-a2c5-8e676451d0ed" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Lock "cinder-quobyte-16b1662f-18b7-47f4-a2c5-8e676451d0ed" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:15 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[44458b07-9293-440e-a0d2-aea2f8f8a6da]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:15 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed Nov 03 16:58:15 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:16 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed" returned: 0 in 0.815s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:16 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed Nov 03 16:58:16 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:16 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-16b1662f-18b7-47f4-a2c5-8e676451d0ed" returned: 0 in 0.432s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Lock "cinder-quobyte-16b1662f-18b7-47f4-a2c5-8e676451d0ed" released by "delete_volume" :: held 1.343s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Created reservations ['b727c41e-aa9f-4740-a8a1-240515af85bd', '288f148e-c7f7-4074-a2c2-9f13699080cb', '22d5582b-551a-4131-b83e-02610c58e8be', '0d080677-d0d7-4845-9051-af00a10fc402'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:16 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:58:16 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:17 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.483s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:17 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Deleted volume successfully. Nov 03 16:58:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d525ef72-e816-4f7d-9dbe-111764fae9d7 tempest-VolumesTestJSON-91015344 None] Lock "cinder-16b1662f-18b7-47f4-a2c5-8e676451d0ed-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Acquiring lock "cinder-57a2f0ff-d695-44f4-a796-9e700ac7a9d5-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Lock "cinder-57a2f0ff-d695-44f4-a796-9e700ac7a9d5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Acquiring lock "cinder-quobyte-57a2f0ff-d695-44f4-a796-9e700ac7a9d5" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Lock "cinder-quobyte-57a2f0ff-d695-44f4-a796-9e700ac7a9d5" acquired by "delete_volume" :: waited 0.037s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:18 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[75793f04-d0e0-4bf8-92c8-d9f9d880cdb3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:18 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 Nov 03 16:58:18 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:18 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5" returned: 0 in 0.809s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:18 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5 Nov 03 16:58:18 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:19 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57a2f0ff-d695-44f4-a796-9e700ac7a9d5" returned: 0 in 0.380s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Lock "cinder-quobyte-57a2f0ff-d695-44f4-a796-9e700ac7a9d5" released by "delete_volume" :: held 1.292s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Created reservations ['4ea5d794-76af-4a20-8817-4afdc72ce943', '424c6a3c-cddb-4495-a314-4a066a549277', '3325aa77-7d37-496d-b1f5-0c6f6b19155f', 'ceaa70dc-807b-43af-b40f-0c491bb34122'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:19 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:58:19 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:19 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.311s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Deleted volume successfully. Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c249ea8-5472-4b64-81c8-0f75e6641832 tempest-VolumesTestJSON-91015344 None] Lock "cinder-57a2f0ff-d695-44f4-a796-9e700ac7a9d5-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-0040c8fa-20b7-42ba-8221-159e91eb3c73 tempest-ServerActionsTestOtherA-1426664864 None] Terminate volume connection completed successfully. Nov 03 16:58:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-0040c8fa-20b7-42ba-8221-159e91eb3c73 tempest-ServerActionsTestOtherA-1426664864 None] Deleting attachment 7608e404-247c-43d1-8833-dee751511623. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "cinder-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Lock "cinder-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "cinder-quobyte-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Lock "cinder-quobyte-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de9736f-3e93-4621-a064-0b572733cb3d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:20 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 Nov 03 16:58:20 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Acquiring lock "cinder-b829fe0c-f95a-434b-9ad1-ff2548e16cd5-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Lock "cinder-b829fe0c-f95a-434b-9ad1-ff2548e16cd5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Acquiring lock "cinder-quobyte-b829fe0c-f95a-434b-9ad1-ff2548e16cd5" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Lock "cinder-quobyte-b829fe0c-f95a-434b-9ad1-ff2548e16cd5" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c91c433-cce3-4a60-a66a-4f3ef3432a3f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:20 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:20 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 Nov 03 16:58:20 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76" returned: 0 in 0.518s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:20 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76 Nov 03 16:58:20 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:20 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76" returned: 0 in 0.288s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Lock "cinder-quobyte-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76" released by "delete_volume" :: held 0.860s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:20 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5" returned: 0 in 0.490s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:21 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5 Nov 03 16:58:21 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.quota [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Created reservations ['22506ce2-5f1b-41e3-975e-24b98a3b71f5', '5e14fdc7-e978-4dcb-81e3-82a8085ccc33', '1c14eb88-00a3-4e56-9e7d-327efd636413', 'aae9e670-f0a5-472b-9d4b-35eab50ebcfe'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:21 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:58:21 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:21 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b829fe0c-f95a-434b-9ad1-ff2548e16cd5" returned: 0 in 0.311s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Lock "cinder-quobyte-b829fe0c-f95a-434b-9ad1-ff2548e16cd5" released by "delete_volume" :: held 0.883s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Created reservations ['9b20b2c0-9d7f-4719-95f4-af6efc7f8f1d', 'd0aa1a47-8597-4731-82ec-003df48d3be9', 'fc65eac4-0906-47c8-a0a1-c7b12ba4af20', 'ad1555dc-436f-46ac-ad19-c89018c16c97'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:21 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.388s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.manager [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Deleted volume successfully. Nov 03 16:58:21 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:58:21 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "cinder-4a680c3c-8ac6-480b-ab48-2369b65c6cc6-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-0175c281-eaf1-468e-80f7-2bd6fc4f308e req-2f59dea8-056f-4024-8e9c-75826132306a tempest-ServerActionsTestOtherA-1426664864 None] Lock "cinder-969d88dd-8f21-4dd4-a0a5-e97dc06c5d76-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Lock "cinder-4a680c3c-8ac6-480b-ab48-2369b65c6cc6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "cinder-quobyte-4a680c3c-8ac6-480b-ab48-2369b65c6cc6" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Lock "cinder-quobyte-4a680c3c-8ac6-480b-ab48-2369b65c6cc6" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26d11f3-c6bf-4c65-a766-9857c38a6f3b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:21 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.397s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Deleted volume successfully. Nov 03 16:58:21 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 Nov 03 16:58:21 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b91d11a-2582-4aa9-b501-ac772307c589 tempest-VolumesTestJSON-91015344 None] Lock "cinder-b829fe0c-f95a-434b-9ad1-ff2548e16cd5-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:22 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6" returned: 0 in 0.477s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:22 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6 Nov 03 16:58:22 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:22 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a680c3c-8ac6-480b-ab48-2369b65c6cc6" returned: 0 in 0.279s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Lock "cinder-quobyte-4a680c3c-8ac6-480b-ab48-2369b65c6cc6" released by "delete_volume" :: held 0.826s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Created reservations ['c7fc7440-ed2b-4410-913a-8d162fcafd3c', 'acf092ba-46e8-41c4-a0d8-111892ded153', 'deaf1512-fa7e-4da9-8499-b011faae1764', 'c0edae8b-0480-4012-a1be-ae676fffaf95'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:22 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:58:22 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:23 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.338s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:23 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Deleted volume successfully. Nov 03 16:58:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-92828949-eba2-40de-b057-99dec1e8cf8b tempest-ServerActionsTestOtherA-1426664864 None] Lock "cinder-4a680c3c-8ac6-480b-ab48-2369b65c6cc6-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:58:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:30 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:58:30 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:31 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.386s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:58:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:58:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:58:32 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=56,cinder:UPDATE=61,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Acquiring lock "cinder-4d7d17a0-532d-46fb-a087-7107682cdb09-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "cinder-4d7d17a0-532d-46fb-a087-7107682cdb09-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=41,cinder:UPDATE=68,cinder:DELETE=9,cinder:INSERT=14 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Acquiring lock "cinder-quobyte-4d7d17a0-532d-46fb-a087-7107682cdb09" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "cinder-quobyte-4d7d17a0-532d-46fb-a087-7107682cdb09" acquired by "delete_volume" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[05049be8-22d2-489c-a40c-2549e8d92834]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:33 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 Nov 03 16:58:33 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a121bd1c-e5ca-404b-8f77-055076ed8aee tempest-GroupsV320Test-75930810 None] Group tempest-GroupsV320Test-Group-1191379381: creating Nov 03 16:58:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a121bd1c-e5ca-404b-8f77-055076ed8aee tempest-GroupsV320Test-75930810 None] Group tempest-GroupsV320Test-Group-1191379381: created successfully Nov 03 16:58:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a121bd1c-e5ca-404b-8f77-055076ed8aee tempest-GroupsV320Test-75930810 None] Create group completed successfully. Nov 03 16:58:33 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09" returned: 0 in 0.536s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:33 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09 Nov 03 16:58:33 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:34 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4d7d17a0-532d-46fb-a087-7107682cdb09" returned: 0 in 0.280s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "cinder-quobyte-4d7d17a0-532d-46fb-a087-7107682cdb09" released by "delete_volume" :: held 0.871s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Created reservations ['c4467c2c-14f5-4caa-a55b-cce94f54c683', 'd0b53077-e880-431d-a1e3-55686521dab9', '6bb59307-792f-4730-a0af-fb482c4af72f', '2a9f960a-b63e-4344-95ee-1318f24367b9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:34 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:58:34 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:34 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Deleted volume successfully. Nov 03 16:58:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83c7f403-3327-479d-acea-1a87c780487e tempest-AttachVolumeShelveTestJSON-1937639774 None] Lock "cinder-4d7d17a0-532d-46fb-a087-7107682cdb09-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:58:35 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Created reservations ['cd130ea7-3709-4569-923b-8188f24bf2bd'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:58:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:35 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:58:35 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:36 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.323s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:36 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-eb9344d7-6d71-454e-8786-117915310f58 tempest-GroupsV320Test-75930810 None] Delete group completed successfully. Nov 03 16:58:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-820a1e12-60c5-4612-9dca-46b68def7ec6 req-24156314-e06c-4ea7-806b-1f9f5cdccab3 tempest-AttachVolumeTestJSON-1054885035 None] Terminate volume connection completed successfully. Nov 03 16:58:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-820a1e12-60c5-4612-9dca-46b68def7ec6 req-24156314-e06c-4ea7-806b-1f9f5cdccab3 tempest-AttachVolumeTestJSON-1054885035 None] Deleting attachment dfa7c367-b128-4034-90df-9541d861852d. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 16:58:47 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=4 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:58:47 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:58:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-735f3ff1-c905-4334-8504-3c9f726cadb0 tempest-BackendsCapabilitiesAdminTestsJSON-1271226474 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86939) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 16:58:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5dbe4aae-0c7f-4d2d-bae9-9d1c9dc19dc2 tempest-BackendsCapabilitiesAdminTestsJSON-1271226474 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86939) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Flow 'volume_create_manager' (d6dd6d8c-ab2e-49f6-9c34-b5bf3e198ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc9a530-2c5d-4d5c-9b5c-4076b20b5572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc9a530-2c5d-4d5c-9b5c-4076b20b5572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-75170138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6007680b-a742-4b95-b047-ad0622b3735e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e335bceff41f448bbf8ce5a5910b5fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:48Z,use_quota=True,user_id='c294d37988fc41629887b816da2b5f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126b32a4-91e3-4cbb-a674-0727d304cbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126b32a4-91e3-4cbb-a674-0727d304cbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884289e0-b199-4792-8076-94a9f8a5158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884289e0-b199-4792-8076-94a9f8a5158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6007680b-a742-4b95-b047-ad0622b3735e', 'volume_name': 'volume-6007680b-a742-4b95-b047-ad0622b3735e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069fdf24-6611-44e3-88e8-bdef0145b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069fdf24-6611-44e3-88e8-bdef0145b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc013720-62cf-488b-af64-4fdcadf6dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:48 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Volume 6007680b-a742-4b95-b047-ad0622b3735e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6007680b-a742-4b95-b047-ad0622b3735e', 'volume_size': 1} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-75170138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6007680b-a742-4b95-b047-ad0622b3735e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e335bceff41f448bbf8ce5a5910b5fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:58:48Z,use_quota=True,user_id='c294d37988fc41629887b816da2b5f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Creating volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:58:48 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:58:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:48 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e 1073741824 Nov 03 16:58:48 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:49 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e 1073741824" returned: 0 in 0.763s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:49 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e Nov 03 16:58:49 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:49 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e" returned: 0 in 0.326s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc013720-62cf-488b-af64-4fdcadf6dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6007680b-a742-4b95-b047-ad0622b3735e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734fab35-6a51-402e-b885-188e685031fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:58:49 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Volume volume-6007680b-a742-4b95-b047-ad0622b3735e (6007680b-a742-4b95-b047-ad0622b3735e): created successfully Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734fab35-6a51-402e-b885-188e685031fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:58:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Flow 'volume_create_manager' (d6dd6d8c-ab2e-49f6-9c34-b5bf3e198ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:58:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3af51b3b-441f-4e55-8071-81e31b8e0321 tempest-SnapshotsActionsTest-1913913766 None] Created volume successfully. Nov 03 16:58:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Creating offline snapshot 7e135671-965e-4076-965e-9d753d68450f of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 16:58:50 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[90291fd6-755b-4027-b51b-6567b8a29658]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:51 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e Nov 03 16:58:51 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:51 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e" returned: 0 in 0.564s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:51 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f 1G Nov 03 16:58:51 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:52 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f 1G" returned: 0 in 0.721s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:52 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:58:52 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:52 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.576s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:52 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f is being set with open permissions: ugo+rw Nov 03 16:58:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:52 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:58:52 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:53 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.511s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:53 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.info Nov 03 16:58:53 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:53 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.info" returned: 0 in 0.463s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:53 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.info is being set with open permissions: ugo+rw Nov 03 16:58:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:53 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.info Nov 03 16:58:53 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:54 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.info" returned: 0 in 0.318s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.304s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-33b0da8b-a62e-40fe-90b1-ff3558aa5378 tempest-SnapshotsActionsTest-1913913766 None] Create snapshot completed successfully Nov 03 16:58:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Creating offline snapshot cf2dff02-013d-419a-9e5f-dce392cd9dcf of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 16:58:56 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b0de4a-ee15-40a2-98fd-a68e5feda97c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:56 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:58:56 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:56 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.514s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:58:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:56 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf 1G Nov 03 16:58:56 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:57 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf 1G" returned: 0 in 0.630s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:57 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf Nov 03 16:58:57 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:57 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf" returned: 0 in 0.506s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:57 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf is being set with open permissions: ugo+rw Nov 03 16:58:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:57 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf Nov 03 16:58:57 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:58 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf" returned: 0 in 0.393s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:58 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-89dcd83e-9cd4-43ec-95d3-ca1b174ea706 tempest-SnapshotsActionsTest-1913913766 None] Create snapshot completed successfully Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-cf2dff02-013d-419a-9e5f-dce392cd9dcf-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-cf2dff02-013d-419a-9e5f-dce392cd9dcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-quobyte-cf2dff02-013d-419a-9e5f-dce392cd9dcf" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-cf2dff02-013d-419a-9e5f-dce392cd9dcf" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Deleting offline snapshot cf2dff02-013d-419a-9e5f-dce392cd9dcf of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] snapshot_file for this snap is: volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfdd9ab-b46d-472b-ba05-dedb81a790e5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:58:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:59 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf Nov 03 16:58:59 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:00 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf" returned: 0 in 0.486s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:00 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2c5738-bb71-463a-bea6-d0d348cfbc40]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:00 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:00 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:00 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.420s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:00 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf Nov 03 16:59:00 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:01 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf" returned: 0 in 0.555s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:01 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf Nov 03 16:59:01 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:01 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cf2dff02-013d-419a-9e5f-dce392cd9dcf" returned: 0 in 0.296s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-cf2dff02-013d-419a-9e5f-dce392cd9dcf" released by "_delete_snapshot" :: held 1.902s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" released by "delete_snapshot" :: held 1.945s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:01 devstack cinder-volume[86939]: WARNING cinder.quota [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 16:59:01 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Created reservations ['64d00573-d9bc-4c12-9815-0534626bb494', '1ad232cc-4983-4480-b3e1-388175832cd8', '3bbb9cfc-805d-4271-a983-810d5491d0e5', '18652cad-f9c8-4a8c-8d15-cb3489cf903e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Delete snapshot completed successfully. Nov 03 16:59:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1881a80d-f750-420e-ace7-1bc338b3239b tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-cf2dff02-013d-419a-9e5f-dce392cd9dcf-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Creating offline snapshot bf3aaf39-88bb-4d52-85d9-64dad74f7c45 of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 16:59:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1322e5-5c5f-4dc6-9e6c-5239a516eef6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:02 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:02 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:02 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.474s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:02 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 1G Nov 03 16:59:02 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:03 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 1G" returned: 0 in 0.588s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:03 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 Nov 03 16:59:03 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:03 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45" returned: 0 in 0.347s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:03 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 is being set with open permissions: ugo+rw Nov 03 16:59:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:03 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 Nov 03 16:59:03 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:04 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45" returned: 0 in 0.332s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:04 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6b5945bc-1f27-4d81-975d-4ac2b9506d97 tempest-SnapshotsActionsTest-1913913766 None] Create snapshot completed successfully Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-bf3aaf39-88bb-4d52-85d9-64dad74f7c45-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-bf3aaf39-88bb-4d52-85d9-64dad74f7c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-quobyte-bf3aaf39-88bb-4d52-85d9-64dad74f7c45" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-bf3aaf39-88bb-4d52-85d9-64dad74f7c45" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Deleting offline snapshot bf3aaf39-88bb-4d52-85d9-64dad74f7c45 of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] snapshot_file for this snap is: volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb8696-aa18-4c22-8d16-dcdfe702caa4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:04 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 Nov 03 16:59:04 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:05 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45" returned: 0 in 0.781s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:05 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a882968-07d8-4012-8dca-5460e0c3de01]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:05 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:05 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:06 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.750s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:06 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 Nov 03 16:59:06 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:07 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45" returned: 0 in 0.772s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:07 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45 Nov 03 16:59:07 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:07 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.bf3aaf39-88bb-4d52-85d9-64dad74f7c45" returned: 0 in 0.362s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-bf3aaf39-88bb-4d52-85d9-64dad74f7c45" released by "_delete_snapshot" :: held 2.889s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" released by "delete_snapshot" :: held 2.921s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:07 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Created reservations ['05198db6-5356-47ce-ba83-1c65fb964ea7', '986f0883-be59-43c0-9cce-0030948b4a69', 'f6e0c8da-a7d7-458b-80d4-e27a60356904', 'a66636ce-e871-40f6-8619-27cdb88f3a2c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Delete snapshot completed successfully. Nov 03 16:59:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58d6c19a-52df-4c4d-8c99-ac39c6762930 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-bf3aaf39-88bb-4d52-85d9-64dad74f7c45-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Creating offline snapshot cd938520-b055-4263-a9f4-8d5a902c7f38 of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 16:59:08 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee78de61-5334-4a60-aa62-c57c09cd8eca]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:09 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:09 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:09 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.569s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:09 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 1G Nov 03 16:59:09 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:10 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 1G" returned: 0 in 0.730s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:10 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 Nov 03 16:59:10 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:10 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38" returned: 0 in 0.581s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:10 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 is being set with open permissions: ugo+rw Nov 03 16:59:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:10 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 Nov 03 16:59:10 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:11 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38" returned: 0 in 0.522s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8245d548-6c93-4557-8f58-c9ffc1e5fedf tempest-SnapshotsActionsTest-1913913766 None] Create snapshot completed successfully Nov 03 16:59:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-cd938520-b055-4263-a9f4-8d5a902c7f38-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-cd938520-b055-4263-a9f4-8d5a902c7f38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-quobyte-cd938520-b055-4263-a9f4-8d5a902c7f38" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-cd938520-b055-4263-a9f4-8d5a902c7f38" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Deleting offline snapshot cd938520-b055-4263-a9f4-8d5a902c7f38 of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] snapshot_file for this snap is: volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af1334d-8226-4b27-b82f-ecce3dd9043d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:12 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 Nov 03 16:59:12 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:12 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5e586a-e91e-4b29-9e64-3bfa0a7957ed]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:12 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:12 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:12 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.428s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:12 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 Nov 03 16:59:12 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:13 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38" returned: 0 in 0.693s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:13 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38 Nov 03 16:59:13 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:14 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.cd938520-b055-4263-a9f4-8d5a902c7f38" returned: 0 in 0.490s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-cd938520-b055-4263-a9f4-8d5a902c7f38" released by "_delete_snapshot" :: held 2.155s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" released by "delete_snapshot" :: held 2.185s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:14 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Created reservations ['709fcd13-bca1-43fe-9c1c-71a760294cea', '739a35d7-7613-4608-a992-7e3e64d48c40', '55b04f46-2af1-446e-acf7-28c23483d204', 'e8e9b541-b022-4bc0-a512-fe56aef16773'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:14 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Delete snapshot completed successfully. Nov 03 16:59:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1a100c6-9de4-453f-801c-628db8806792 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-cd938520-b055-4263-a9f4-8d5a902c7f38-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Creating offline snapshot dfb5d786-a686-4e58-b315-940c68fdc041 of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 16:59:15 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[236153fd-c612-4a5b-8d91-5977aa4faea6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:16 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:16 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:16 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.673s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:16 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 1G Nov 03 16:59:16 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:17 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 1G" returned: 0 in 0.630s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:17 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 Nov 03 16:59:17 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:17 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041" returned: 0 in 0.374s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:17 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 is being set with open permissions: ugo+rw Nov 03 16:59:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:17 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 Nov 03 16:59:17 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:17 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041" returned: 0 in 0.316s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a0dfa49a-5ab8-4add-8816-12b2758f00f0 tempest-SnapshotsActionsTest-1913913766 None] Create snapshot completed successfully Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-dfb5d786-a686-4e58-b315-940c68fdc041-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-dfb5d786-a686-4e58-b315-940c68fdc041-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Acquiring lock "cinder-quobyte-dfb5d786-a686-4e58-b315-940c68fdc041" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-dfb5d786-a686-4e58-b315-940c68fdc041" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Deleting offline snapshot dfb5d786-a686-4e58-b315-940c68fdc041 of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] snapshot_file for this snap is: volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae383c2-2808-46ab-bfe1-d3a0a4d63c1e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:19 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 Nov 03 16:59:19 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:19 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041" returned: 0 in 0.562s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9970d5-ce31-40d2-aa22-a88846d9620b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:20 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:20 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:20 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.565s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:20 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 Nov 03 16:59:20 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:21 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041" returned: 0 in 0.511s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:21 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041 Nov 03 16:59:21 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:21 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.dfb5d786-a686-4e58-b315-940c68fdc041" returned: 0 in 0.275s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-dfb5d786-a686-4e58-b315-940c68fdc041" released by "_delete_snapshot" :: held 2.085s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" released by "delete_snapshot" :: held 2.116s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:21 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Created reservations ['9b0352d7-ad62-4caf-a20d-0906ad150b47', '0d1cb02b-9932-40f6-b818-f8dbdd8b17f0', 'e4c2241d-475a-41a4-b676-1bb9afd10e1b', '87669c7b-d277-47b6-9192-4b97298ec93a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Delete snapshot completed successfully. Nov 03 16:59:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12ee09bd-f206-4c0d-953a-f6ee98332b78 tempest-SnapshotsActionsTest-540625182 None] Lock "cinder-dfb5d786-a686-4e58-b315-940c68fdc041-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "cinder-7e135671-965e-4076-965e-9d753d68450f-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-7e135671-965e-4076-965e-9d753d68450f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "cinder-quobyte-7e135671-965e-4076-965e-9d753d68450f" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-quobyte-7e135671-965e-4076-965e-9d753d68450f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Deleting offline snapshot 7e135671-965e-4076-965e-9d753d68450f of volume 6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] snapshot_file for this snap is: volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a0a7f-15c4-4d6d-8934-8f275c36ea29]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:23 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:23 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:23 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.591s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6007680b-a742-4b95-b047-ad0622b3735e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9872f5-9c71-4f63-9a1a-06fba681f837]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:24 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e Nov 03 16:59:24 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:24 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e" returned: 0 in 0.682s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:24 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:24 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:25 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.678s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:25 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f Nov 03 16:59:25 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:25 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e.7e135671-965e-4076-965e-9d753d68450f" returned: 0 in 0.376s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-quobyte-7e135671-965e-4076-965e-9d753d68450f" released by "_delete_snapshot" :: held 2.552s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" released by "delete_snapshot" :: held 2.587s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:25 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Created reservations ['abc3c473-d4a7-463a-960e-b92fbc72b6c8', '43cf1e33-c417-4143-92db-64717af0caa8', '8e7cfb23-7688-4fc5-b1df-9c3632d2f7f4', '5f6832b7-bd79-4d3b-996c-d70fa313d9fa'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Delete snapshot completed successfully. Nov 03 16:59:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-79b54a96-a50e-414a-bae9-542c37943e04 tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-7e135671-965e-4076-965e-9d753d68450f-delete_snapshot" released by "delete_snapshot" :: held 2.779s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "cinder-6007680b-a742-4b95-b047-ad0622b3735e-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-6007680b-a742-4b95-b047-ad0622b3735e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc13ab4-05b4-462e-8968-62c05926b1cb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:26 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e Nov 03 16:59:26 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:27 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e" returned: 0 in 0.558s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:27 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e Nov 03 16:59:27 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:27 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6007680b-a742-4b95-b047-ad0622b3735e" returned: 0 in 0.597s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-quobyte-6007680b-a742-4b95-b047-ad0622b3735e" released by "delete_volume" :: held 1.274s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:27 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Created reservations ['49fb4f2e-f641-41f2-add0-138ea48beb75', '5be7b5c9-b01a-4b26-93d5-2f96943e4721', 'f3cd48da-afa4-49f8-bd69-2cfa1237598e', '54ad3977-26ef-4867-8791-9840c159e8f4'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:28 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:59:28 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:28 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:59:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Deleted volume successfully. Nov 03 16:59:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-536a232b-a47e-40ab-ae22-57258359745a tempest-SnapshotsActionsTest-1913913766 None] Lock "cinder-6007680b-a742-4b95-b047-ad0622b3735e-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Flow 'volume_create_manager' (803eb629-dd4f-4a19-9bf8-421c1a17cffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5aa79c-3e4d-4a70-a5df-4e2868a9d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5aa79c-3e4d-4a70-a5df-4e2868a9d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1269558633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6d4e89-8769-47f7-8958-5c28b5c9a452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a818a82f5a4bc58bd133132a2083ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:31Z,use_quota=True,user_id='e8aa84abdd04476c8bca6c115b8d1328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c75f51-dc1d-463d-a40b-c3e518013b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c75f51-dc1d-463d-a40b-c3e518013b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd85c30-6705-436a-a3bf-1b3c559fe5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd85c30-6705-436a-a3bf-1b3c559fe5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6d4e89-8769-47f7-8958-5c28b5c9a452', 'volume_name': 'volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee096058-2789-41ab-9997-8dff6a6c0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee096058-2789-41ab-9997-8dff6a6c0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e348018-11d4-4d0e-8d14-8ffea1b903cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:30 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Volume 1d6d4e89-8769-47f7-8958-5c28b5c9a452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452', 'volume_size': 1} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1269558633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6d4e89-8769-47f7-8958-5c28b5c9a452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a818a82f5a4bc58bd133132a2083ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:31Z,use_quota=True,user_id='e8aa84abdd04476c8bca6c115b8d1328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Creating volume 1d6d4e89-8769-47f7-8958-5c28b5c9a452 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:59:30 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:30 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 1073741824 Nov 03 16:59:30 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:30 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:59:30 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:31 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 1073741824" returned: 0 in 0.499s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:31 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.345s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:31 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 Nov 03 16:59:31 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:31 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452" returned: 0 in 0.323s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e348018-11d4-4d0e-8d14-8ffea1b903cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef2423e-2431-41f9-b652-28b7f4e47fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:31 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Volume volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 (1d6d4e89-8769-47f7-8958-5c28b5c9a452): created successfully Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef2423e-2431-41f9-b652-28b7f4e47fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Flow 'volume_create_manager' (803eb629-dd4f-4a19-9bf8-421c1a17cffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b3fee741-5a9e-46f9-bfae-f2b77e0992df tempest-VolumesTransfersV357Test-285109760 None] Created volume successfully. Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Flow 'volume_create_manager' (47715196-9072-4685-8ae6-20de965682ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616dae73-c2cf-4f83-8baf-2d1a66b68663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616dae73-c2cf-4f83-8baf-2d1a66b68663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2102057370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f01b757-a04b-4726-80f3-7b766ba60314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='613c4b7fe61b469390ce2f4696f58682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:32Z,use_quota=True,user_id='4a41a7a38c6b4b4a81673b31d158103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed7d8c8-0def-4f14-a995-16a6d313afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed7d8c8-0def-4f14-a995-16a6d313afb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50be288d-5e16-4072-bf44-0acd29af847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50be288d-5e16-4072-bf44-0acd29af847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f01b757-a04b-4726-80f3-7b766ba60314', 'volume_name': 'volume-5f01b757-a04b-4726-80f3-7b766ba60314', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd25e6e4-aba7-420b-9db4-d9914a2d5aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd25e6e4-aba7-420b-9db4-d9914a2d5aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1015773-cbac-45f5-9c3d-cb939f4c5bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:32 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Volume 5f01b757-a04b-4726-80f3-7b766ba60314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f01b757-a04b-4726-80f3-7b766ba60314', 'volume_size': 1} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2102057370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f01b757-a04b-4726-80f3-7b766ba60314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='613c4b7fe61b469390ce2f4696f58682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:32Z,use_quota=True,user_id='4a41a7a38c6b4b4a81673b31d158103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Creating volume 5f01b757-a04b-4726-80f3-7b766ba60314 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:59:32 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:59:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:32 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 1073741824 Nov 03 16:59:32 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:33 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 1073741824" returned: 0 in 0.610s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:33 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 Nov 03 16:59:33 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:33 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314" returned: 0 in 0.384s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1015773-cbac-45f5-9c3d-cb939f4c5bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f01b757-a04b-4726-80f3-7b766ba60314', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce673c6e-d39f-4e5f-aae8-83f47b8766be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:33 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Volume volume-5f01b757-a04b-4726-80f3-7b766ba60314 (5f01b757-a04b-4726-80f3-7b766ba60314): created successfully Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce673c6e-d39f-4e5f-aae8-83f47b8766be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Flow 'volume_create_manager' (47715196-9072-4685-8ae6-20de965682ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3138fcd9-006e-4231-927c-802aad244321 tempest-AttachVolumeNegativeTest-454184678 None] Created volume successfully. Nov 03 16:59:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f88fa422-ef58-4acd-ac1b-30e547ab14d3 tempest-VolumesTransfersV357Test-1818516895 None] Transfer volume completed successfully. Nov 03 16:59:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Acquiring lock "cinder-1d6d4e89-8769-47f7-8958-5c28b5c9a452-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Lock "cinder-1d6d4e89-8769-47f7-8958-5c28b5c9a452-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Acquiring lock "cinder-quobyte-1d6d4e89-8769-47f7-8958-5c28b5c9a452" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Lock "cinder-quobyte-1d6d4e89-8769-47f7-8958-5c28b5c9a452" acquired by "delete_volume" :: waited 0.043s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:34 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c1a01a-4d44-4a20-9ec7-62fb9303d80b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:34 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 Nov 03 16:59:34 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:35 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452" returned: 0 in 0.497s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:35 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452 Nov 03 16:59:35 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:35 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1d6d4e89-8769-47f7-8958-5c28b5c9a452" returned: 0 in 0.482s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Lock "cinder-quobyte-1d6d4e89-8769-47f7-8958-5c28b5c9a452" released by "delete_volume" :: held 1.063s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-9bc318a5-630a-404c-bbdf-02bd3da05059 req-1f9235c0-e518-42d5-ac27-716a54fb7079 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-9bc318a5-630a-404c-bbdf-02bd3da05059 req-1f9235c0-e518-42d5-ac27-716a54fb7079 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-9bc318a5-630a-404c-bbdf-02bd3da05059 req-1f9235c0-e518-42d5-ac27-716a54fb7079 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Created reservations ['25e30828-39c2-4aa9-a592-aa99a17c0fbf', '54e69839-a4ee-48b3-a011-34b0cea2cf4a', '9393bb0e-1d07-42e0-9f44-2595ec6b91ba', 'cc7d9cdd-3a17-4e90-8d03-14def845571a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-9bc318a5-630a-404c-bbdf-02bd3da05059 req-1f9235c0-e518-42d5-ac27-716a54fb7079 tempest-AttachVolumeNegativeTest-454184678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-5f01b757-a04b-4726-80f3-7b766ba60314', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac723674-7673-43e8-86ad-6e5692f58f02', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:59:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-9bc318a5-630a-404c-bbdf-02bd3da05059 req-1f9235c0-e518-42d5-ac27-716a54fb7079 tempest-AttachVolumeNegativeTest-454184678 None] attachment_update completed successfully. Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:36 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:59:36 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:36 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.334s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:59:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Deleted volume successfully. Nov 03 16:59:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07f1086f-92f1-44c7-838b-2f34271573d7 tempest-VolumesTransfersV357Test-1445719871 None] Lock "cinder-1d6d4e89-8769-47f7-8958-5c28b5c9a452-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Flow 'volume_create_manager' (e1183456-fffb-4f60-81ca-8946a38d657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d919a21a-7024-4cf1-abfe-2ccf91140aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d919a21a-7024-4cf1-abfe-2ccf91140aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1729632970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a818a82f5a4bc58bd133132a2083ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:38Z,use_quota=True,user_id='e8aa84abdd04476c8bca6c115b8d1328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33835150-820d-44e9-9897-b1ed9cdabc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33835150-820d-44e9-9897-b1ed9cdabc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bc60b9-3a1c-47ed-81b5-ad5a81b29798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bc60b9-3a1c-47ed-81b5-ad5a81b29798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645', 'volume_name': 'volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc4c209-3dfe-4834-8993-ea878cc439ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc4c209-3dfe-4834-8993-ea878cc439ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bed94d9-d9f5-485e-a2e6-59e46a42167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:37 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Volume 6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645', 'volume_size': 1} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1729632970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a818a82f5a4bc58bd133132a2083ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:38Z,use_quota=True,user_id='e8aa84abdd04476c8bca6c115b8d1328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Creating volume 6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:59:37 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:59:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:37 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 1073741824 Nov 03 16:59:37 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:38 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 1073741824" returned: 0 in 0.531s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:38 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 Nov 03 16:59:38 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:38 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645" returned: 0 in 0.297s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bed94d9-d9f5-485e-a2e6-59e46a42167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5dacbe-8239-4a89-be09-d40bd0dddca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:38 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Volume volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 (6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645): created successfully Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5dacbe-8239-4a89-be09-d40bd0dddca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Flow 'volume_create_manager' (e1183456-fffb-4f60-81ca-8946a38d657b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-37591b26-c125-416b-8595-1fddba709317 tempest-VolumesTransfersV357Test-285109760 None] Created volume successfully. Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Acquiring lock "cinder-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Lock "cinder-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Acquiring lock "cinder-quobyte-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Lock "cinder-quobyte-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645" acquired by "delete_volume" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6043c8-2ac1-495e-bfa6-d9beda8daf82]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:40 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 Nov 03 16:59:40 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:40 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645" returned: 0 in 0.424s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:40 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645 Nov 03 16:59:40 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:40 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645" returned: 0 in 0.310s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Lock "cinder-quobyte-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645" released by "delete_volume" :: held 0.782s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Created reservations ['a6f0863c-3e9f-4d86-8ebe-68f5fee4fb33', '0fc616bb-819d-43f4-9a84-44372ec22e39', '1f65a3ae-87d2-4d28-a69c-e1aacd893228', '1293bbcb-754b-41fc-a896-55da86bc8bbc'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:41 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:59:41 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:41 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.337s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:59:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Deleted volume successfully. Nov 03 16:59:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-217a1119-7c75-4c37-a1a8-ca905dd89e32 tempest-VolumesTransfersV357Test-1445719871 None] Lock "cinder-6c2dc96b-2ea1-4f52-9fbf-5dbe1c6e6645-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=68,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=67,cinder:UPDATE=70,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Flow 'volume_create_manager' (b48aeeda-66b2-44cb-8424-9472b022685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329cf913-e9a8-4e22-8ba7-0a122042e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329cf913-e9a8-4e22-8ba7-0a122042e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1976379430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca650579e0324474870c58f4d07fe5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:52Z,use_quota=True,user_id='9bc651b4b4474144973f2dd9fea8a070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7643c3d-91e8-47e3-b396-1440f5f6ef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7643c3d-91e8-47e3-b396-1440f5f6ef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550509c6-168e-4fde-a5d8-c254c2af7bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550509c6-168e-4fde-a5d8-c254c2af7bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449', 'volume_name': 'volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b8e34e-130d-4c28-bdc7-37bf8a44c7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b8e34e-130d-4c28-bdc7-37bf8a44c7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b003a779-889e-466d-928b-aff1d64cfe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:51 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Volume 69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449', 'volume_size': 1} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1976379430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca650579e0324474870c58f4d07fe5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:52Z,use_quota=True,user_id='9bc651b4b4474144973f2dd9fea8a070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Creating volume 69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:59:51 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:59:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:51 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 1073741824 Nov 03 16:59:51 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:52 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 1073741824" returned: 0 in 0.787s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:52 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 Nov 03 16:59:52 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:53 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449" returned: 0 in 0.437s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b003a779-889e-466d-928b-aff1d64cfe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c260ce7e-e9ce-4011-ba21-5263de4ef3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Volume volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 (69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449): created successfully Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c260ce7e-e9ce-4011-ba21-5263de4ef3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Flow 'volume_create_manager' (b48aeeda-66b2-44cb-8424-9472b022685d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:53 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c56fb004-5159-4c49-b1f5-5937f3b8e2d1 tempest-AttachVolumeTestJSON-1054885035 None] Created volume successfully. Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (013c88ab-ec09-4e60-9db2-b8d5052b66e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e1f3d4-9463-40ff-922e-07f43f129a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e1f3d4-9463-40ff-922e-07f43f129a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1674776596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd29320f-0063-4548-ba01-1eaa544b0d26,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:53Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecba8f8a-d225-42cb-ba46-d6f541028da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecba8f8a-d225-42cb-ba46-d6f541028da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bf248b-4ed0-4972-89f9-6e50503dfe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bf248b-4ed0-4972-89f9-6e50503dfe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd29320f-0063-4548-ba01-1eaa544b0d26', 'volume_name': 'volume-fd29320f-0063-4548-ba01-1eaa544b0d26', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e488cf-e682-4b07-9436-fc7996c5af5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e488cf-e682-4b07-9436-fc7996c5af5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d00baef-f7c6-45ca-824f-c85dc19f3b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Volume fd29320f-0063-4548-ba01-1eaa544b0d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd29320f-0063-4548-ba01-1eaa544b0d26', 'volume_size': 1} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1674776596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd29320f-0063-4548-ba01-1eaa544b0d26,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:53Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Creating volume fd29320f-0063-4548-ba01-1eaa544b0d26 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:59:53 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:59:53 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 1073741824 Nov 03 16:59:53 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Flow 'volume_create_manager' (9399b4cd-44fd-4e82-af99-280a6707cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7b0374-3814-4fb3-b69a-c3bbd4e6db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7b0374-3814-4fb3-b69a-c3bbd4e6db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-314494179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8d2575-8980-4f67-87bd-a58a42533dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d666aea99884974873ef5945996556d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:53Z,use_quota=True,user_id='a74e11a52ae6403b9f339fbe39ee8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9ce6a08-c32a-450c-92d5-c39abe3d0cb9),volume_type_id=f9ce6a08-c32a-450c-92d5-c39abe3d0cb9)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc76181c-76a9-4c65-b526-73c38200ee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc76181c-76a9-4c65-b526-73c38200ee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7904df2b-6316-4b70-8b11-85111b333204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7904df2b-6316-4b70-8b11-85111b333204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8d2575-8980-4f67-87bd-a58a42533dc7', 'volume_name': 'volume-9f8d2575-8980-4f67-87bd-a58a42533dc7', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a977509-7961-41de-ab1a-ed901257f247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a977509-7961-41de-ab1a-ed901257f247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297307cc-60cc-492c-9025-ff763d08afac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Volume 9f8d2575-8980-4f67-87bd-a58a42533dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8d2575-8980-4f67-87bd-a58a42533dc7', 'volume_size': 1} Nov 03 16:59:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:54 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 1073741824" returned: 0 in 0.490s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:54 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 Nov 03 16:59:54 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:54 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26" returned: 0 in 0.263s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-314494179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8d2575-8980-4f67-87bd-a58a42533dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d666aea99884974873ef5945996556d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:53Z,use_quota=True,user_id='a74e11a52ae6403b9f339fbe39ee8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9ce6a08-c32a-450c-92d5-c39abe3d0cb9),volume_type_id=f9ce6a08-c32a-450c-92d5-c39abe3d0cb9)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Creating volume 9f8d2575-8980-4f67-87bd-a58a42533dc7 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:59:54 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:54 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 1073741824 Nov 03 16:59:54 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d00baef-f7c6-45ca-824f-c85dc19f3b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd29320f-0063-4548-ba01-1eaa544b0d26', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99e0afb-cd15-4303-a11b-2c6892217fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:54 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Volume volume-fd29320f-0063-4548-ba01-1eaa544b0d26 (fd29320f-0063-4548-ba01-1eaa544b0d26): created successfully Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99e0afb-cd15-4303-a11b-2c6892217fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (013c88ab-ec09-4e60-9db2-b8d5052b66e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cd8aebbe-b20f-4caa-a98f-28074c690af5 tempest-VolumesGetTest-501723569 None] Created volume successfully. Nov 03 16:59:55 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 1073741824" returned: 0 in 0.532s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-cd428949-87d1-44d9-85b1-902b05bfb276 req-150c544e-b2ac-42e8-9f4d-4b55cc8ed580 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:55 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 Nov 03 16:59:55 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:55 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7" returned: 0 in 0.285s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-cd428949-87d1-44d9-85b1-902b05bfb276 req-150c544e-b2ac-42e8-9f4d-4b55cc8ed580 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.308s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297307cc-60cc-492c-9025-ff763d08afac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8d2575-8980-4f67-87bd-a58a42533dc7', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ae432d-0257-403e-b470-fba1e25817dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-cd428949-87d1-44d9-85b1-902b05bfb276 req-150c544e-b2ac-42e8-9f4d-4b55cc8ed580 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:55 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Volume volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 (9f8d2575-8980-4f67-87bd-a58a42533dc7): created successfully Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ae432d-0257-403e-b470-fba1e25817dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Flow 'volume_create_manager' (9399b4cd-44fd-4e82-af99-280a6707cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:55 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6fecb29a-92df-4e5e-bc17-57d3c0e49f8c tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Created volume successfully. Nov 03 16:59:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-cd428949-87d1-44d9-85b1-902b05bfb276 req-150c544e-b2ac-42e8-9f4d-4b55cc8ed580 tempest-AttachVolumeTestJSON-1054885035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4b823fc-f672-4ce2-a9f3-7268a8d595f3', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 16:59:55 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-cd428949-87d1-44d9-85b1-902b05bfb276 req-150c544e-b2ac-42e8-9f4d-4b55cc8ed580 tempest-AttachVolumeTestJSON-1054885035 None] attachment_update completed successfully. Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (a76cfd5d-7d03-4e23-883f-ad7666446163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37b9163-a26b-4486-a11b-48e856b47384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37b9163-a26b-4486-a11b-48e856b47384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-964977971',display_name='tempest-VolumesGetTest-Volume-347997022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5588098c-96e1-4d80-bdd6-2aca8497e0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:56Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585b77f4-39d7-413d-9054-2523af968640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585b77f4-39d7-413d-9054-2523af968640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79c48de-cf7a-4557-a3d7-0fef82276fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79c48de-cf7a-4557-a3d7-0fef82276fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5588098c-96e1-4d80-bdd6-2aca8497e0e3', 'volume_name': 'volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea2b3dd-7819-4d95-92a0-8bc2640f8c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea2b3dd-7819-4d95-92a0-8bc2640f8c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1161428-7668-43ee-9577-19c72f82feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:56 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Volume 5588098c-96e1-4d80-bdd6-2aca8497e0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3', 'volume_size': 1} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-964977971',display_name='tempest-VolumesGetTest-Volume-347997022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5588098c-96e1-4d80-bdd6-2aca8497e0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:56Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Creating volume 5588098c-96e1-4d80-bdd6-2aca8497e0e3 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:59:56 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:56 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 1073741824 Nov 03 16:59:56 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:56 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:59:56 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:56 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 1073741824" returned: 0 in 0.517s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:57 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 Nov 03 16:59:57 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:57 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.320s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:59:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6617aa75-f67c-4eff-8a3f-68cf2c9d660d tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Retype volume completed successfully. Nov 03 16:59:57 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3" returned: 0 in 0.321s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1161428-7668-43ee-9577-19c72f82feec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e224622-1089-497b-bb25-55688a10d69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:57 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Volume volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 (5588098c-96e1-4d80-bdd6-2aca8497e0e3): created successfully Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e224622-1089-497b-bb25-55688a10d69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (a76cfd5d-7d03-4e23-883f-ad7666446163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-96e7b804-6ff0-453a-8191-330204c1dca7 tempest-VolumesGetTest-501723569 None] Created volume successfully. Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Flow 'volume_create_manager' (c633a157-3cf4-433f-8451-3bdd71b012c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a31d13-df0d-4194-a3b9-0caeb49e3248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a31d13-df0d-4194-a3b9-0caeb49e3248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-689447467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df900a7-52c0-44b5-9043-2e1be965d73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca650579e0324474870c58f4d07fe5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:58Z,use_quota=True,user_id='9bc651b4b4474144973f2dd9fea8a070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5017830b-2e22-40b7-9c1b-690a52cc8a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5017830b-2e22-40b7-9c1b-690a52cc8a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a7baaf-0d37-48a2-bb06-1acfb2b160c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a7baaf-0d37-48a2-bb06-1acfb2b160c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df900a7-52c0-44b5-9043-2e1be965d73e', 'volume_name': 'volume-0df900a7-52c0-44b5-9043-2e1be965d73e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8045a44e-b8af-43a1-9669-c9d90ae4f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8045a44e-b8af-43a1-9669-c9d90ae4f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027f3fdd-51bb-4462-aba9-3b242e3fd6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:57 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Volume 0df900a7-52c0-44b5-9043-2e1be965d73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df900a7-52c0-44b5-9043-2e1be965d73e', 'volume_size': 1} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T15:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-689447467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df900a7-52c0-44b5-9043-2e1be965d73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca650579e0324474870c58f4d07fe5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:59:58Z,use_quota=True,user_id='9bc651b4b4474144973f2dd9fea8a070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Creating volume 0df900a7-52c0-44b5-9043-2e1be965d73e {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 16:59:57 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 16:59:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:57 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e 1073741824 Nov 03 16:59:57 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Acquiring lock "cinder-9f8d2575-8980-4f67-87bd-a58a42533dc7-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "cinder-9f8d2575-8980-4f67-87bd-a58a42533dc7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Acquiring lock "cinder-quobyte-9f8d2575-8980-4f67-87bd-a58a42533dc7" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "cinder-quobyte-9f8d2575-8980-4f67-87bd-a58a42533dc7" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1707691f-e69d-426a-95be-c24c82346814]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:58 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 Nov 03 16:59:58 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:58 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e 1073741824" returned: 0 in 0.613s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-5588098c-96e1-4d80-bdd6-2aca8497e0e3-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:58 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e Nov 03 16:59:58 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Lock "cinder-5588098c-96e1-4d80-bdd6-2aca8497e0e3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-5588098c-96e1-4d80-bdd6-2aca8497e0e3" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-5588098c-96e1-4d80-bdd6-2aca8497e0e3" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5bc318-43f9-4924-a0f4-61cdba6f1def]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:58 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7" returned: 0 in 0.595s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:58 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 Nov 03 16:59:58 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:58 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7 Nov 03 16:59:58 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:59 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e" returned: 0 in 0.414s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027f3fdd-51bb-4462-aba9-3b242e3fd6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df900a7-52c0-44b5-9043-2e1be965d73e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc2bd04-9105-4785-acec-a27239d9c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 16:59:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Volume volume-0df900a7-52c0-44b5-9043-2e1be965d73e (0df900a7-52c0-44b5-9043-2e1be965d73e): created successfully Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc2bd04-9105-4785-acec-a27239d9c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Flow 'volume_create_manager' (c633a157-3cf4-433f-8451-3bdd71b012c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 16:59:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3b2eb214-039b-418e-b331-73915a49ebd7 tempest-AttachVolumeTestJSON-1054885035 None] Created volume successfully. Nov 03 16:59:59 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:59 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9f8d2575-8980-4f67-87bd-a58a42533dc7" returned: 0 in 0.336s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:59 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3 Nov 03 16:59:59 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "cinder-quobyte-9f8d2575-8980-4f67-87bd-a58a42533dc7" released by "delete_volume" :: held 0.984s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:59 devstack cinder-volume[86939]: WARNING cinder.quota [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 16:59:59 devstack cinder-volume[86939]: WARNING cinder.quota [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Created reservations ['aa2e4a21-4a40-4ef6-8279-28eb55b42e25', '6520d4f6-3efd-499f-ae0f-b4bf18f483d5', '2d136f70-1560-4a53-81af-97bb50d4d812', '634e3008-30c1-41c5-a4d2-1821f15ff74e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:59 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:59:59 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:59 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5588098c-96e1-4d80-bdd6-2aca8497e0e3" returned: 0 in 0.290s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-5588098c-96e1-4d80-bdd6-2aca8497e0e3" released by "delete_volume" :: held 0.820s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Created reservations ['3ae13802-5023-4a68-8f76-0e91915694fd', 'bea7941a-8664-4a3f-8bea-346205532654', '8d20ece5-2865-4084-b1ff-15e930a4911e', 'feee5afa-b394-4127-a8b3-54224aba87c9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:59 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 16:59:59 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:59 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.267s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:59:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Deleted volume successfully. Nov 03 16:59:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99f89a7d-fd63-4150-af88-4b3a999b57d0 tempest-VolumeRetypeWithoutMigrationTest-129173581 None] Lock "cinder-9f8d2575-8980-4f67-87bd-a58a42533dc7-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:00 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.336s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-fd29320f-0063-4548-ba01-1eaa544b0d26-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Deleted volume successfully. Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Lock "cinder-fd29320f-0063-4548-ba01-1eaa544b0d26-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-63759b41-829f-4ff2-8357-6404949af850 tempest-VolumesGetTest-501723569 None] Lock "cinder-5588098c-96e1-4d80-bdd6-2aca8497e0e3-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-fd29320f-0063-4548-ba01-1eaa544b0d26" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-fd29320f-0063-4548-ba01-1eaa544b0d26" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51fe14e-db4b-4576-a6ff-2d6af00144bb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:00 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 Nov 03 17:00:00 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:00 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26" returned: 0 in 0.432s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:00 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26 Nov 03 17:00:00 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:00 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fd29320f-0063-4548-ba01-1eaa544b0d26" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-fd29320f-0063-4548-ba01-1eaa544b0d26" released by "delete_volume" :: held 0.892s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Created reservations ['6b3aa7f4-1be8-43c0-89dc-4c5380fbcb8e', 'd1f53d6f-6d93-49f0-a27e-b523bbb5e05b', 'a3d46d4b-4df7-4794-94b8-1249ac05421a', '25ed2ccc-4b99-496b-a3f1-f4d01f85a812'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:01 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:01 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-fd3efb88-4598-4789-bcd1-7eba245e0e47 req-58edc2de-bb5c-42ef-af30-60aecb7c2bf8 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-fd3efb88-4598-4789-bcd1-7eba245e0e47 req-58edc2de-bb5c-42ef-af30-60aecb7c2bf8 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-fd3efb88-4598-4789-bcd1-7eba245e0e47 req-58edc2de-bb5c-42ef-af30-60aecb7c2bf8 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-fd3efb88-4598-4789-bcd1-7eba245e0e47 req-58edc2de-bb5c-42ef-af30-60aecb7c2bf8 tempest-AttachVolumeTestJSON-1054885035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-0df900a7-52c0-44b5-9043-2e1be965d73e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3a81386-21ce-4dde-ad7e-214816a614f1', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:00:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-fd3efb88-4598-4789-bcd1-7eba245e0e47 req-58edc2de-bb5c-42ef-af30-60aecb7c2bf8 tempest-AttachVolumeTestJSON-1054885035 None] attachment_update completed successfully. Nov 03 17:00:01 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.541s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Deleted volume successfully. Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5fbb06e1-0494-4ec2-a8da-098860993dd1 tempest-VolumesGetTest-501723569 None] Lock "cinder-fd29320f-0063-4548-ba01-1eaa544b0d26-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:01 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (9fba77bc-c4a0-454a-9b1e-70403428c540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a20e3c-2e72-4321-9a79-f25938256ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a20e3c-2e72-4321-9a79-f25938256ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-251003438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df98eb7e-5383-4350-a328-c5609be8409a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:02Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca875638-37e9-4761-ae0d-c76466eea244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca875638-37e9-4761-ae0d-c76466eea244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1838e313-de96-4e4e-9eaa-add40b67546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1838e313-de96-4e4e-9eaa-add40b67546f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df98eb7e-5383-4350-a328-c5609be8409a', 'volume_name': 'volume-df98eb7e-5383-4350-a328-c5609be8409a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f86fc4-dae5-4fbc-a8be-432d540a857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f86fc4-dae5-4fbc-a8be-432d540a857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8b18b1-8144-41d1-be9a-e02232d503d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Volume df98eb7e-5383-4350-a328-c5609be8409a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df98eb7e-5383-4350-a328-c5609be8409a', 'volume_size': 1} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-251003438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df98eb7e-5383-4350-a328-c5609be8409a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:02Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Creating volume df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:02 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:02 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a 1073741824 Nov 03 17:00:02 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:02 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a 1073741824" returned: 0 in 0.745s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:02 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a Nov 03 17:00:02 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:03 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a" returned: 0 in 0.298s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8b18b1-8144-41d1-be9a-e02232d503d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df98eb7e-5383-4350-a328-c5609be8409a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739cc672-211a-45cb-bf2d-14b81073702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:03 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Volume volume-df98eb7e-5383-4350-a328-c5609be8409a (df98eb7e-5383-4350-a328-c5609be8409a): created successfully Nov 03 17:00:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739cc672-211a-45cb-bf2d-14b81073702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (9fba77bc-c4a0-454a-9b1e-70403428c540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:03 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f75a8a56-68df-4da3-b22f-b0c9d58f7704 tempest-VolumesGetTest-501723569 None] Created volume successfully. Nov 03 17:00:04 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-a4116206-fe90-44d7-a5e1-aa7a2c6a0379 req-04ddccd7-bfcc-46ef-807c-a0624c303008 tempest-AttachVolumeTestJSON-1054885035 None] Terminate volume connection completed successfully. Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-a4116206-fe90-44d7-a5e1-aa7a2c6a0379 req-04ddccd7-bfcc-46ef-807c-a0624c303008 tempest-AttachVolumeTestJSON-1054885035 None] Deleting attachment b4b823fc-f672-4ce2-a9f3-7268a8d595f3. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (8c780a47-fada-4d86-ab59-f86c3d77502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fe6f5a-b350-4837-9ac6-5551d6cb0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fe6f5a-b350-4837-9ac6-5551d6cb0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1823568145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c817fc6-9d86-4729-9924-dc2657626768,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=df98eb7e-5383-4350-a328-c5609be8409a,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:05Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c1d553-d61d-4b35-aeb6-0d01bd8a4686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c1d553-d61d-4b35-aeb6-0d01bd8a4686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b835ebb6-cf58-46c9-9ba7-c432da8329d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b835ebb6-cf58-46c9-9ba7-c432da8329d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6c817fc6-9d86-4729-9924-dc2657626768', 'volume_name': 'volume-6c817fc6-9d86-4729-9924-dc2657626768', 'volume_size': 1, 'source_volid': 'df98eb7e-5383-4350-a328-c5609be8409a', 'source_volstatus': 'available'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fbd0c0-440f-4d54-87ef-12c2725cc7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fbd0c0-440f-4d54-87ef-12c2725cc7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e75715-2f66-417e-a9d0-f9261c9462ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:04 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Volume 6c817fc6-9d86-4729-9924-dc2657626768: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6c817fc6-9d86-4729-9924-dc2657626768', 'volume_size': 1, 'source_volid': 'df98eb7e-5383-4350-a328-c5609be8409a', 'source_volstatus': 'available'} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:04 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Cloning volume df98eb7e-5383-4350-a328-c5609be8409a to volume 6c817fc6-9d86-4729-9924-dc2657626768 Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Creating offline snapshot b4979588-6256-403d-97ac-a3b7e01e004c of volume df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b76803e-cca9-460b-b463-9b36b4ab300c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:04 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a Nov 03 17:00:04 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:05 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a" returned: 0 in 0.449s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:05 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c 1G Nov 03 17:00:05 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-72c327f0-6a85-4433-b121-af7d189f3eb3 req-b13e9b87-993e-4720-be70-adc798675461 tempest-AttachVolumeTestJSON-1054885035 None] Terminate volume connection completed successfully. Nov 03 17:00:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-72c327f0-6a85-4433-b121-af7d189f3eb3 req-b13e9b87-993e-4720-be70-adc798675461 tempest-AttachVolumeTestJSON-1054885035 None] Deleting attachment b3a81386-21ce-4dde-ad7e-214816a614f1. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:00:05 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c 1G" returned: 0 in 0.503s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df98eb7e-5383-4350-a328-c5609be8409a -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:05 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df98eb7e-5383-4350-a328-c5609be8409a -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c Nov 03 17:00:05 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:06 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df98eb7e-5383-4350-a328-c5609be8409a -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c" returned: 0 in 0.329s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:06 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c is being set with open permissions: ugo+rw Nov 03 17:00:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:06 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c Nov 03 17:00:06 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:06 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c" returned: 0 in 0.261s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:06 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.info Nov 03 17:00:06 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:06 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.info" returned: 0 in 0.313s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:06 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.info is being set with open permissions: ugo+rw Nov 03 17:00:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:06 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.info Nov 03 17:00:06 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:07 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.info" returned: 0 in 0.310s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-6c817fc6-9d86-4729-9924-dc2657626768" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-6c817fc6-9d86-4729-9924-dc2657626768" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] snapshot: b4979588-6256-403d-97ac-a3b7e01e004c, volume: 6c817fc6-9d86-4729-9924-dc2657626768, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de259ab-a2c2-47bf-9a72-6dcef0367cef]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:07 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c Nov 03 17:00:07 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:07 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c" returned: 0 in 0.650s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df98eb7e-5383-4350-a328-c5609be8409a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e120fd-51eb-4f2e-be2e-a129da5b211b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:07 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a Nov 03 17:00:07 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:08 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a" returned: 0 in 0.588s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:00:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:00:08 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:00:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:08 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 Nov 03 17:00:08 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "cinder-0df900a7-52c0-44b5-9043-2e1be965d73e-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-0df900a7-52c0-44b5-9043-2e1be965d73e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "cinder-quobyte-0df900a7-52c0-44b5-9043-2e1be965d73e" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-quobyte-0df900a7-52c0-44b5-9043-2e1be965d73e" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b513ae-44b5-4c4a-a713-4e9dcbc87f16]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:14 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e Nov 03 17:00:14 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:15 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e" returned: 0 in 0.662s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:15 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e Nov 03 17:00:15 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:15 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0df900a7-52c0-44b5-9043-2e1be965d73e" returned: 0 in 0.830s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-quobyte-0df900a7-52c0-44b5-9043-2e1be965d73e" released by "delete_volume" :: held 1.659s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Created reservations ['75c20067-24ee-4be1-92ba-c35ba1b77b96', 'fb061257-91c1-4eb6-8dd3-2d66cef9b16a', '826cd2f0-e37f-4483-8793-6e02693532ec', 'dd7a5396-8dcc-4d45-968f-b19c701c7fa5'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:16 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:16 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "cinder-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449-delete_volume" acquired by "delete_volume" :: waited 0.176s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "cinder-quobyte-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:17 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.862s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:17 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Deleted volume successfully. Nov 03 17:00:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-quobyte-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449" acquired by "delete_volume" :: waited 0.069s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b54e6c60-50ec-49f9-b81b-cdada0ac5faa tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-0df900a7-52c0-44b5-9043-2e1be965d73e-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:17 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e6b013-a3b1-4777-a3f6-4f5c7eb1f56c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:17 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 Nov 03 17:00:17 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:18 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449" returned: 0 in 1.231s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:18 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449 Nov 03 17:00:18 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:19 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768" returned: 0 in 10.630s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a, size 1024.00 MB, duration 10.63 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:00:19 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Converted 1024.00 MB image at 96.32 MB/s Nov 03 17:00:19 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 is being set with open permissions: ugo+rw Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:19 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 Nov 03 17:00:19 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:19 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449" returned: 0 in 0.465s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-quobyte-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449" released by "delete_volume" :: held 1.844s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Created reservations ['4bca5516-415a-4398-9cfd-58967e90ccf2', '29770666-3f75-4b09-841e-12250b06d769', '08e777b7-84cc-45ee-a86b-ecd5e8120814', '34edb387-c60b-41b9-98d1-15dd33729c67'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:19 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:19 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:19 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768" returned: 0 in 0.326s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-6c817fc6-9d86-4729-9924-dc2657626768" released by "_copy_volume_from_snapshot" :: held 12.315s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-b4979588-6256-403d-97ac-a3b7e01e004c" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-b4979588-6256-403d-97ac-a3b7e01e004c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Deleting offline snapshot b4979588-6256-403d-97ac-a3b7e01e004c of volume df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] snapshot_file for this snap is: volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c437f4-8be5-434e-98b4-610a1aa6f7d1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "cinder-2cc660c5-f9f7-44de-a899-7a6587296b41-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-2cc660c5-f9f7-44de-a899-7a6587296b41-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:19 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.320s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Deleted volume successfully. Nov 03 17:00:19 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c Nov 03 17:00:19 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "cinder-quobyte-2cc660c5-f9f7-44de-a899-7a6587296b41" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cd76080e-f441-4fd9-93ed-6972f20b76d3 tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-69b4cb4b-bfc7-4f1f-afb9-cbaedf1fe449-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-quobyte-2cc660c5-f9f7-44de-a899-7a6587296b41" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[340f2be7-a874-4cb9-ab35-d5bb951de79c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:19 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 Nov 03 17:00:19 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:20 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c" returned: 0 in 0.485s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df98eb7e-5383-4350-a328-c5609be8409a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[20731cb1-e94a-4dc9-b43d-0e695b44e0ca]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:20 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a Nov 03 17:00:20 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:20 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41" returned: 0 in 0.460s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:20 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41 Nov 03 17:00:20 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:20 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2cc660c5-f9f7-44de-a899-7a6587296b41" returned: 0 in 0.298s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-quobyte-2cc660c5-f9f7-44de-a899-7a6587296b41" released by "delete_volume" :: held 0.825s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Created reservations ['69ac4904-b77a-41b7-a7cd-7310151750b7', 'a8bbee87-ee0f-4e60-99d8-6b45315b909c', 'f343ba5e-f48e-4da9-bad6-363dafb98dd0', '26c0857d-8d5d-4866-a7c7-a5c4fa3f5840'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:20 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a" returned: 0 in 0.711s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:20 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:20 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:20 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c Nov 03 17:00:20 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:21 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.481s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:21 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c" returned: 0 in 0.470s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Deleted volume successfully. Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6b105b64-b2c1-4c2b-9df3-87fbfecf0e7a tempest-AttachVolumeTestJSON-1054885035 None] Lock "cinder-2cc660c5-f9f7-44de-a899-7a6587296b41-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:21 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c Nov 03 17:00:21 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:21 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a.b4979588-6256-403d-97ac-a3b7e01e004c" returned: 0 in 0.321s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-b4979588-6256-403d-97ac-a3b7e01e004c" released by "_delete_snapshot" :: held 2.146s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.912s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e75715-2f66-417e-a9d0-f9261c9462ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c817fc6-9d86-4729-9924-dc2657626768', 'volume_size': 1, 'source_volid': 'df98eb7e-5383-4350-a328-c5609be8409a', 'source_volstatus': 'available'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a2232d-3ffc-435f-b824-7cc1a8b756cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:21 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Volume volume-6c817fc6-9d86-4729-9924-dc2657626768 (6c817fc6-9d86-4729-9924-dc2657626768): created successfully Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a2232d-3ffc-435f-b824-7cc1a8b756cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (8c780a47-fada-4d86-ab59-f86c3d77502c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ac1489d9-d7f8-4f6d-9123-9e86239c9d82 tempest-VolumesGetTest-501723569 None] Created volume successfully. Nov 03 17:00:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-0f2b3770-405b-427c-9353-b39e45b02b6a req-e7b7d453-7332-432f-b641-e24899d07a0b tempest-AttachVolumeNegativeTest-454184678 None] Terminate volume connection completed successfully. Nov 03 17:00:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-0f2b3770-405b-427c-9353-b39e45b02b6a req-e7b7d453-7332-432f-b641-e24899d07a0b tempest-AttachVolumeNegativeTest-454184678 None] Deleting attachment ac723674-7673-43e8-86ad-6e5692f58f02. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:00:22 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Flow 'volume_create_manager' (989562e3-ab5e-4f8b-98b8-6010f2e8cf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9badd7-bd3b-4f11-a2d7-ba17dacd73d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9badd7-bd3b-4f11-a2d7-ba17dacd73d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-658366805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b911e6-5384-4ba1-bdd9-774a03221ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1077b882a61418eb1e5e0cf898415b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:23Z,use_quota=True,user_id='338152e2d1fb4d808e1a6b0a3a098a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd63cd31-90f5-4359-a02a-e43ecef7a2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd63cd31-90f5-4359-a02a-e43ecef7a2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8e3ed9-359c-417a-bce4-e2b82652f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8e3ed9-359c-417a-bce4-e2b82652f143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b911e6-5384-4ba1-bdd9-774a03221ede', 'volume_name': 'volume-65b911e6-5384-4ba1-bdd9-774a03221ede', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3789ed-9d70-46b3-8dfc-9d048190d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3789ed-9d70-46b3-8dfc-9d048190d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fc2df6-9b61-4e75-a44b-47edcd30e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Volume 65b911e6-5384-4ba1-bdd9-774a03221ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b911e6-5384-4ba1-bdd9-774a03221ede', 'volume_size': 1} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-658366805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b911e6-5384-4ba1-bdd9-774a03221ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1077b882a61418eb1e5e0cf898415b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:23Z,use_quota=True,user_id='338152e2d1fb4d808e1a6b0a3a098a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Creating volume 65b911e6-5384-4ba1-bdd9-774a03221ede {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:23 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:23 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede 1073741824 Nov 03 17:00:23 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (f99c3a2c-3b15-4743-aca9-8b57abc5ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4f1d94-e353-4617-9877-09459564783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4f1d94-e353-4617-9877-09459564783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1975139892',display_name='tempest-VolumesGetTest-Volume-1156205694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300e8bd9-d55f-4d71-946f-4c9c08a05ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:24Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d44167-4301-4527-b4fb-23f83f0e0e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d44167-4301-4527-b4fb-23f83f0e0e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8a820e-3e12-477c-a1fb-f8f0ad5feea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8a820e-3e12-477c-a1fb-f8f0ad5feea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300e8bd9-d55f-4d71-946f-4c9c08a05ac6', 'volume_name': 'volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac91d6c6-54ee-4060-a65c-91ec7d8d7d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac91d6c6-54ee-4060-a65c-91ec7d8d7d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd7cb48-2763-42d6-9fbc-d99a5428d8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:23 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Volume 300e8bd9-d55f-4d71-946f-4c9c08a05ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6', 'volume_size': 1} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:23 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede 1073741824" returned: 0 in 0.779s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:23 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede Nov 03 17:00:23 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:24 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede" returned: 0 in 0.301s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1975139892',display_name='tempest-VolumesGetTest-Volume-1156205694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300e8bd9-d55f-4d71-946f-4c9c08a05ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:24Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Creating volume 300e8bd9-d55f-4d71-946f-4c9c08a05ac6 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:24 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:24 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 1073741824 Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fc2df6-9b61-4e75-a44b-47edcd30e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b911e6-5384-4ba1-bdd9-774a03221ede', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:24 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75eb14a-5fc8-4bde-a5b4-5dd89ae643e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:24 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Volume volume-65b911e6-5384-4ba1-bdd9-774a03221ede (65b911e6-5384-4ba1-bdd9-774a03221ede): created successfully Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75eb14a-5fc8-4bde-a5b4-5dd89ae643e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Flow 'volume_create_manager' (989562e3-ab5e-4f8b-98b8-6010f2e8cf5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f614b667-bfca-4176-99bb-2da6ab69e087 tempest-AbsoluteLimitsTests-1876661895 None] Created volume successfully. Nov 03 17:00:24 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 1073741824" returned: 0 in 0.565s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:24 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 Nov 03 17:00:24 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:25 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6" returned: 0 in 0.273s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd7cb48-2763-42d6-9fbc-d99a5428d8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1dbd3a-9d20-4a2b-9f94-354a2c40f7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:25 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Volume volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 (300e8bd9-d55f-4d71-946f-4c9c08a05ac6): created successfully Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1dbd3a-9d20-4a2b-9f94-354a2c40f7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (f99c3a2c-3b15-4743-aca9-8b57abc5ea28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d738d0f4-bd65-4ccb-886f-3bd1d3127631 tempest-VolumesGetTest-501723569 None] Created volume successfully. Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Acquiring lock "cinder-65b911e6-5384-4ba1-bdd9-774a03221ede-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Lock "cinder-65b911e6-5384-4ba1-bdd9-774a03221ede-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Acquiring lock "cinder-quobyte-65b911e6-5384-4ba1-bdd9-774a03221ede" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Lock "cinder-quobyte-65b911e6-5384-4ba1-bdd9-774a03221ede" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aff0ff-e8b8-4ae0-9ba4-351890599feb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:25 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede Nov 03 17:00:25 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:25 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede" returned: 0 in 0.413s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:25 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede Nov 03 17:00:25 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-300e8bd9-d55f-4d71-946f-4c9c08a05ac6-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Lock "cinder-300e8bd9-d55f-4d71-946f-4c9c08a05ac6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-300e8bd9-d55f-4d71-946f-4c9c08a05ac6" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-300e8bd9-d55f-4d71-946f-4c9c08a05ac6" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[21633f80-5b62-4f94-af02-0b90d585cd70]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:26 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-65b911e6-5384-4ba1-bdd9-774a03221ede" returned: 0 in 0.405s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Lock "cinder-quobyte-65b911e6-5384-4ba1-bdd9-774a03221ede" released by "delete_volume" :: held 0.877s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:26 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 Nov 03 17:00:26 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Created reservations ['8feaa92f-31d8-4338-841e-b7e5d9d052a2', 'c4e3920e-e0c4-4f1e-8075-69e9013e905d', '7588c615-dedd-403e-87a9-2ed1d4429208', 'f681a947-cac3-469f-ac8b-54ec352d4be0'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:26 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:26 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:26 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6" returned: 0 in 0.568s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:26 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6 Nov 03 17:00:26 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:26 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.429s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Deleted volume successfully. Nov 03 17:00:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dd96c56d-0fe8-43c4-b751-ddd6164a1771 tempest-AbsoluteLimitsTests-1876661895 None] Lock "cinder-65b911e6-5384-4ba1-bdd9-774a03221ede-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:27 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-300e8bd9-d55f-4d71-946f-4c9c08a05ac6" returned: 0 in 0.430s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-300e8bd9-d55f-4d71-946f-4c9c08a05ac6" released by "delete_volume" :: held 1.080s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Created reservations ['1d4ca8cc-34c3-49ba-b75a-873f85b71c07', '73531374-3c2f-4741-ad33-9f102888635c', '3847d8c4-303a-4d97-a546-fd639f853092', '2e0ca1b1-f92a-48f2-98c0-8b3d818cc64c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:27 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:27 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:27 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.374s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Deleted volume successfully. Nov 03 17:00:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a27468f3-ecec-48dc-846f-833635d619f9 tempest-VolumesGetTest-501723569 None] Lock "cinder-300e8bd9-d55f-4d71-946f-4c9c08a05ac6-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-6c817fc6-9d86-4729-9924-dc2657626768-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Lock "cinder-6c817fc6-9d86-4729-9924-dc2657626768-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-6c817fc6-9d86-4729-9924-dc2657626768" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-6c817fc6-9d86-4729-9924-dc2657626768" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:28 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db65cac-0393-47ba-a0b0-54cd10f18ca0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:28 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 Nov 03 17:00:28 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:28 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768" returned: 0 in 0.447s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:29 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768 Nov 03 17:00:29 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:29 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6c817fc6-9d86-4729-9924-dc2657626768" returned: 0 in 0.321s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-6c817fc6-9d86-4729-9924-dc2657626768" released by "delete_volume" :: held 0.825s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Created reservations ['2cfe5991-e954-4a88-afc3-fe0ae20021ae', '77bf92e5-a2d3-4007-80c4-bb2e6de12e52', '3aa44166-acae-492e-be58-739a5630cb6b', '5ae8d5a8-38ec-4f97-b18b-a379897c45af'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:29 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:29 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-df98eb7e-5383-4350-a328-c5609be8409a-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Lock "cinder-df98eb7e-5383-4350-a328-c5609be8409a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:29 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.389s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Deleted volume successfully. Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-df98eb7e-5383-4350-a328-c5609be8409a" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-09dd1fd3-26c2-4e3e-bcb5-f52e7e1da1ef tempest-VolumesGetTest-501723569 None] Lock "cinder-6c817fc6-9d86-4729-9924-dc2657626768-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-df98eb7e-5383-4350-a328-c5609be8409a" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[105afb6f-14e7-48a9-a64c-1f8dfaeb0590]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:30 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a Nov 03 17:00:30 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:30 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a" returned: 0 in 0.471s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:30 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a Nov 03 17:00:30 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:30 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-df98eb7e-5383-4350-a328-c5609be8409a" returned: 0 in 0.376s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-df98eb7e-5383-4350-a328-c5609be8409a" released by "delete_volume" :: held 0.937s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:30 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:30 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Created reservations ['44fc13d9-328a-4ec0-bde4-7bc6aba31f08', 'f96b764a-3899-4fc5-a00e-826e5ba853ed', 'bd62580d-9a23-41b1-a67b-cdd895e8cc87', '7a282699-e253-4707-8f5b-4cc3c4a900fb'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:31 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:31 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:31 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.481s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:00:31 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.363s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Deleted volume successfully. Nov 03 17:00:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8eaa940f-b683-47b7-914f-03c59dad779d tempest-VolumesGetTest-501723569 None] Lock "cinder-df98eb7e-5383-4350-a328-c5609be8409a-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:33 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (c5ebd8c3-e608-41c4-8daa-7e5089ef9344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1454a6-bf2d-4515-a76a-565e9ec6d909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1454a6-bf2d-4515-a76a-565e9ec6d909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1698439896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2493485f-3708-4d3d-9a45-2684176b1681,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:34Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44a066-f988-463a-ba43-90b77c3edfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44a066-f988-463a-ba43-90b77c3edfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b63cab8-350e-4c07-acc1-01a928a6740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:00:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-deca866c-c081-4d62-8fcb-ec7ecb133189 tempest-GroupSnapshotsTest-1875826730 None] Group tempest-GroupSnapshotsTest-Group-231720690: creating Nov 03 17:00:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-deca866c-c081-4d62-8fcb-ec7ecb133189 tempest-GroupSnapshotsTest-1875826730 None] Group tempest-GroupSnapshotsTest-Group-231720690: created successfully Nov 03 17:00:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-deca866c-c081-4d62-8fcb-ec7ecb133189 tempest-GroupSnapshotsTest-1875826730 None] Create group completed successfully. Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b63cab8-350e-4c07-acc1-01a928a6740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2493485f-3708-4d3d-9a45-2684176b1681', 'volume_name': 'volume-2493485f-3708-4d3d-9a45-2684176b1681', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6b9c26-dbd5-4f97-a0fa-12d8029b4458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6b9c26-dbd5-4f97-a0fa-12d8029b4458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee698d79-f517-4a7e-8fe1-3ca54546455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Volume 2493485f-3708-4d3d-9a45-2684176b1681: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2493485f-3708-4d3d-9a45-2684176b1681', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Trying to clone 2493485f-3708-4d3d-9a45-2684176b1681 from image d3081758-5b01-49fb-b109-4441003b66a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Flow 'volume_create_manager' (5dab340c-9258-46b3-a09d-bef0e4a309ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0c00a2-d766-4f1f-a6e5-059924c6f914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0c00a2-d766-4f1f-a6e5-059924c6f914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-246735722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10709bb2-d079-40ec-a8fd-b0e754d35f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a7246df0e246fcb6f9e41b68de4cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:35Z,use_quota=True,user_id='0f6b6d60d7584fed875accf12e9de9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e4fd0-064e-4f6d-acaf-36ccfbd4cbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e4fd0-064e-4f6d-acaf-36ccfbd4cbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bff5f1-a075-47b9-98ff-7019e7678f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bff5f1-a075-47b9-98ff-7019e7678f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10709bb2-d079-40ec-a8fd-b0e754d35f09', 'volume_name': 'volume-10709bb2-d079-40ec-a8fd-b0e754d35f09', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168356b6-bcc8-427c-a34f-a70d1704eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168356b6-bcc8-427c-a34f-a70d1704eff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ed26eb-7fb6-44b3-8c03-97694caf1316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:34 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Volume 10709bb2-d079-40ec-a8fd-b0e754d35f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10709bb2-d079-40ec-a8fd-b0e754d35f09', 'volume_size': 1} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-246735722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10709bb2-d079-40ec-a8fd-b0e754d35f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a7246df0e246fcb6f9e41b68de4cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:35Z,use_quota=True,user_id='0f6b6d60d7584fed875accf12e9de9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Creating volume 10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:34 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:34 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 1073741824 Nov 03 17:00:34 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:34 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:00:34 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[de658e77-cb92-4a3a-88b8-4cebceea93ce]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:35 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD Nov 03 17:00:35 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:35 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 1073741824" returned: 0 in 0.638s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:35 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 is fetched for user 4d14be5142a842aeae59977caedcfa76. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:00:35 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 Nov 03 17:00:35 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aca443-7be2-41d3-b9f6-42b6d51f96b8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:35 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD Nov 03 17:00:35 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:35 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09" returned: 0 in 0.412s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ed26eb-7fb6-44b3-8c03-97694caf1316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10709bb2-d079-40ec-a8fd-b0e754d35f09', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345559d0-bf39-4f82-b036-7f4da8cbfa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:35 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Volume volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 (10709bb2-d079-40ec-a8fd-b0e754d35f09): created successfully Nov 03 17:00:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345559d0-bf39-4f82-b036-7f4da8cbfa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Flow 'volume_create_manager' (5dab340c-9258-46b3-a09d-bef0e4a309ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e6c2e154-e8da-407c-b19c-d5aa937a5648 tempest-VolumesDeleteCascade-651665537 None] Created volume successfully. Nov 03 17:00:36 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1698439896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2493485f-3708-4d3d-9a45-2684176b1681,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:34Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Creating volume 2493485f-3708-4d3d-9a45-2684176b1681 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:36 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:36 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 1073741824 Nov 03 17:00:36 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Flow 'volume_create_manager' (d87d21e2-1af1-4c47-97c0-e21c30761305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eacad3-d6e3-4f70-809b-386ceb349f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eacad3-d6e3-4f70-809b-386ceb349f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-758177635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52f712ad-c703-4f88-89ad-1384928710ef,host='devstack@QuobyteHD#QuobyteHD',id=a65942e0-1b5c-427d-a14a-c404fc310ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713a4baa568c448f843d18fe99c5e06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:36Z,use_quota=True,user_id='657e3c414c2c40e88972d71512b533b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb1ad11b-aad8-4323-b06e-db1d11d9b5aa),volume_type_id=fb1ad11b-aad8-4323-b06e-db1d11d9b5aa)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5405980-ca2a-4eea-b00b-aea68fe4c72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5405980-ca2a-4eea-b00b-aea68fe4c72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a97832-a33c-407f-b5ab-e425258ab2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a97832-a33c-407f-b5ab-e425258ab2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65942e0-1b5c-427d-a14a-c404fc310ce1', 'volume_name': 'volume-a65942e0-1b5c-427d-a14a-c404fc310ce1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2371ea69-44e0-4e44-8ab3-b4eadd0d03ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2371ea69-44e0-4e44-8ab3-b4eadd0d03ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa6e19e-1ae7-4809-8244-65af8d807e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:36 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Volume a65942e0-1b5c-427d-a14a-c404fc310ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65942e0-1b5c-427d-a14a-c404fc310ce1', 'volume_size': 1} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:36 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 1073741824" returned: 0 in 0.544s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:36 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 Nov 03 17:00:36 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:37 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681" returned: 0 in 0.266s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52f712ad-c703-4f88-89ad-1384928710ef,created_at=2026-11-03T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-758177635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52f712ad-c703-4f88-89ad-1384928710ef,host='devstack@QuobyteHD#QuobyteHD',id=a65942e0-1b5c-427d-a14a-c404fc310ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713a4baa568c448f843d18fe99c5e06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:36Z,use_quota=True,user_id='657e3c414c2c40e88972d71512b533b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb1ad11b-aad8-4323-b06e-db1d11d9b5aa),volume_type_id=fb1ad11b-aad8-4323-b06e-db1d11d9b5aa)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Creating volume a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:37 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:37 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 1073741824 Nov 03 17:00:37 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Attempting download of d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume 2493485f-3708-4d3d-9a45-2684176b1681. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed89cf03-28a2-41fb-b3d5-b66a1ea167ae]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dm2a_k6c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:37 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dm2a_k6c Nov 03 17:00:37 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:37 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 1073741824" returned: 0 in 0.630s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:37 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dm2a_k6c" returned: 0 in 0.445s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dm2a_k6c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:37 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 Nov 03 17:00:37 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:38 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dm2a_k6c Nov 03 17:00:38 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:38 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1" returned: 0 in 0.291s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.297s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa6e19e-1ae7-4809-8244-65af8d807e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65942e0-1b5c-427d-a14a-c404fc310ce1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fad3436-73c7-471f-bef0-1e05b3e1c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Creating offline snapshot e67c6a5a-cb41-4111-b62b-264f6ecbe385 of volume 10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:00:38 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Volume volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 (a65942e0-1b5c-427d-a14a-c404fc310ce1): created successfully Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fad3436-73c7-471f-bef0-1e05b3e1c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Flow 'volume_create_manager' (d87d21e2-1af1-4c47-97c0-e21c30761305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f4c03-58e5-4d24-8817-f04cabe2fa97]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:38 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-dda1866b-c49a-4628-9204-83a98d6970cd tempest-GroupSnapshotsTest-1875826730 None] Created volume successfully. Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dm2a_k6c" returned: 1 in 0.478s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dm2a_k6c' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9defa2a5-ddf9-4483-a851-a38972f1aabc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:38 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 Nov 03 17:00:38 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:38 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD Nov 03 17:00:38 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:39 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:39 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] d3081758-5b01-49fb-b109-4441003b66a8 was qcow2, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:00:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:39 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 Nov 03 17:00:39 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:39 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09" returned: 0 in 0.850s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:39 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 1G Nov 03 17:00:39 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] GroupSnapshot ae1c68e8-4fd3-4372-96cd-a11cddf9ca06: creating. Nov 03 17:00:39 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Group snapshot ae1c68e8-4fd3-4372-96cd-a11cddf9ca06: creating. {{(pid=86939) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:00:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:40 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 1G" returned: 0 in 0.849s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:40 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 Nov 03 17:00:40 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:40 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385" returned: 0 in 0.441s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:40 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 is being set with open permissions: ugo+rw Nov 03 17:00:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:40 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 Nov 03 17:00:40 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:40 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385" returned: 0 in 0.418s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:40 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.info Nov 03 17:00:40 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:41 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.info" returned: 0 in 0.323s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:41 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.info is being set with open permissions: ugo+rw Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:41 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.info Nov 03 17:00:41 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:41 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.info" returned: 0 in 0.347s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.407s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.834s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Creating offline snapshot f5563349-b0a6-4c54-b5a5-2e4b11552bd6 of volume a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:00:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f5796005-615d-46d2-8c51-e5c59f22ebe4 tempest-VolumesDeleteCascade-651665537 None] Create snapshot completed successfully Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cee0db4-63e1-42e8-8602-802539a610de]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:41 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 Nov 03 17:00:41 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:41 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681" returned: 0 in 2.886s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_tt_oh_wrdevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:00:41 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Converted 112.00 MB image at 38.79 MB/s Nov 03 17:00:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:41 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 1G Nov 03 17:00:41 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:42 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1" returned: 0 in 0.581s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:42 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 1G Nov 03 17:00:42 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:42 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 1G" returned: 0 in 0.623s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Downloaded image d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume 2493485f-3708-4d3d-9a45-2684176b1681 successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 for user 4d14be5142a842aeae59977caedcfa76 is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Marking volume 2493485f-3708-4d3d-9a45-2684176b1681 as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Copying metadata from image d3081758-5b01-49fb-b109-4441003b66a8 to 2493485f-3708-4d3d-9a45-2684176b1681. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Creating volume glance metadata for volume 2493485f-3708-4d3d-9a45-2684176b1681 backed by image d3081758-5b01-49fb-b109-4441003b66a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee698d79-f517-4a7e-8fe1-3ca54546455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2493485f-3708-4d3d-9a45-2684176b1681', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c5591e-4ddd-4f3b-b782-811d570fc1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:42 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Volume volume-2493485f-3708-4d3d-9a45-2684176b1681 (2493485f-3708-4d3d-9a45-2684176b1681): created successfully Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c5591e-4ddd-4f3b-b782-811d570fc1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (c5ebd8c3-e608-41c4-8daa-7e5089ef9344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d5d5b6d3-c3ef-4e09-a9c7-6ac70220ef32 tempest-VolumesGetTest-501723569 None] Created volume successfully. Nov 03 17:00:43 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 1G" returned: 0 in 0.790s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:43 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 Nov 03 17:00:43 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:43 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6" returned: 0 in 0.410s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:43 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:00:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:43 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 Nov 03 17:00:43 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:43 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6" returned: 0 in 0.284s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:43 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.info Nov 03 17:00:43 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:44 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.info" returned: 0 in 0.364s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:44 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:44 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.info Nov 03 17:00:44 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:44 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.info" returned: 0 in 0.319s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.879s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Creating offline snapshot a7af7a40-1f13-4906-8715-5b2e9aaca629 of volume 10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4dd3b7-ab4d-4852-bba8-b70515e5d6b4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a3d1038c-0c14-4255-a1a7-c38fbc7092f7 tempest-GroupSnapshotsTest-1875826730 None] group_snapshot ae1c68e8-4fd3-4372-96cd-a11cddf9ca06: created successfully Nov 03 17:00:44 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 Nov 03 17:00:44 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (bcff88f8-f9f7-4a04-a4b7-f1281c455087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162d966e-9e6a-4ebc-9008-891b103a976c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162d966e-9e6a-4ebc-9008-891b103a976c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-351179247',display_name='tempest-VolumesGetTest-Volume-75052589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825f5008-1747-41be-ac4a-76353e91d251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:45Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb6d8a8-fee7-4076-9b17-4846d6d8c3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb6d8a8-fee7-4076-9b17-4846d6d8c3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee2bab2-ea8b-47df-a43c-2b4056a15d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee2bab2-ea8b-47df-a43c-2b4056a15d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825f5008-1747-41be-ac4a-76353e91d251', 'volume_name': 'volume-825f5008-1747-41be-ac4a-76353e91d251', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b1992f-a908-465e-ae14-23f5656dd296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b1992f-a908-465e-ae14-23f5656dd296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c2381f-006e-4981-a988-ddb4dac3d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:45 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Volume 825f5008-1747-41be-ac4a-76353e91d251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825f5008-1747-41be-ac4a-76353e91d251', 'volume_size': 1} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:45 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385" returned: 0 in 0.504s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10709bb2-d079-40ec-a8fd-b0e754d35f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:45 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 1G Nov 03 17:00:45 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:45 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 1G" returned: 0 in 0.530s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:45 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 Nov 03 17:00:45 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:46 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629" returned: 0 in 0.375s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:46 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 is being set with open permissions: ugo+rw Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:46 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 Nov 03 17:00:46 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:46 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629" returned: 0 in 0.290s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.363s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-351179247',display_name='tempest-VolumesGetTest-Volume-75052589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825f5008-1747-41be-ac4a-76353e91d251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d83be13d1b4b8790cca899b9fc6e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:45Z,use_quota=True,user_id='4d14be5142a842aeae59977caedcfa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Creating volume 825f5008-1747-41be-ac4a-76353e91d251 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:46 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:46 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 1073741824 Nov 03 17:00:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b73263c0-cea4-4cd2-943e-1778fe31b05a tempest-VolumesDeleteCascade-651665537 None] Create snapshot completed successfully Nov 03 17:00:46 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-10709bb2-d079-40ec-a8fd-b0e754d35f09-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:46 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 1073741824" returned: 0 in 0.517s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-10709bb2-d079-40ec-a8fd-b0e754d35f09-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Performing cascade delete. {{(pid=86939) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-a7af7a40-1f13-4906-8715-5b2e9aaca629-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:47 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 Nov 03 17:00:47 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-a7af7a40-1f13-4906-8715-5b2e9aaca629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-a7af7a40-1f13-4906-8715-5b2e9aaca629" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-a7af7a40-1f13-4906-8715-5b2e9aaca629" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Deleting offline snapshot a7af7a40-1f13-4906-8715-5b2e9aaca629 of volume 10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] snapshot_file for this snap is: volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eebf002-b908-467a-9387-f9de7e457af5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:47 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 Nov 03 17:00:47 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:47 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251" returned: 0 in 0.289s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.078s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-f5563349-b0a6-4c54-b5a5-2e4b11552bd6-2868ed3b-cb5f-4d33-b310-bf678634bac9" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c2381f-006e-4981-a988-ddb4dac3d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825f5008-1747-41be-ac4a-76353e91d251', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eca48f2-f308-4587-b632-03b96e256680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-f5563349-b0a6-4c54-b5a5-2e4b11552bd6-2868ed3b-cb5f-4d33-b310-bf678634bac9" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Creating volume 2868ed3b-cb5f-4d33-b310-bf678634bac9 from snapshot f5563349-b0a6-4c54-b5a5-2e4b11552bd6 {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-2868ed3b-cb5f-4d33-b310-bf678634bac9" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:47 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Volume volume-825f5008-1747-41be-ac4a-76353e91d251 (825f5008-1747-41be-ac4a-76353e91d251): created successfully Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eca48f2-f308-4587-b632-03b96e256680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Flow 'volume_create_manager' (bcff88f8-f9f7-4a04-a4b7-f1281c455087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-2868ed3b-cb5f-4d33-b310-bf678634bac9" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] snapshot: f5563349-b0a6-4c54-b5a5-2e4b11552bd6, volume: 2868ed3b-cb5f-4d33-b310-bf678634bac9, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9a786b3d-c02c-420a-887c-f99a11e3369c tempest-VolumesGetTest-501723569 None] Created volume successfully. Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8520fc4e-0eea-4148-8210-f1c02c50210c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:47 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 Nov 03 17:00:47 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:47 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629" returned: 0 in 0.505s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10709bb2-d079-40ec-a8fd-b0e754d35f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[706c8e1f-bc67-4f68-b368-f99848c03bd6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:47 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 Nov 03 17:00:47 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:47 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a65942e0-1b5c-427d-a14a-c404fc310ce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f4c712-58e1-4dfc-a52d-2c8ff585be85]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:48 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 Nov 03 17:00:48 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:48 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385" returned: 0 in 0.448s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10709bb2-d079-40ec-a8fd-b0e754d35f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:48 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 Nov 03 17:00:48 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-825f5008-1747-41be-ac4a-76353e91d251-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:48 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1" returned: 0 in 0.465s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Lock "cinder-825f5008-1747-41be-ac4a-76353e91d251-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:48 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 Nov 03 17:00:48 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-825f5008-1747-41be-ac4a-76353e91d251" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-825f5008-1747-41be-ac4a-76353e91d251" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d928da33-92ad-4461-a09d-a156d7e3e59e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:48 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629" returned: 0 in 0.489s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:48 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629 Nov 03 17:00:48 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:48 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 Nov 03 17:00:48 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:48 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.a7af7a40-1f13-4906-8715-5b2e9aaca629" returned: 0 in 0.369s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:49 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-a7af7a40-1f13-4906-8715-5b2e9aaca629" released by "_delete_snapshot" :: held 1.992s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251" returned: 0 in 0.606s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" released by "delete_snapshot" :: held 2.085s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:49 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251 Nov 03 17:00:49 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Created reservations ['f7574b11-6ff0-4d1e-aca1-4d3531aac5ad', '4dbcad0c-c9cc-4e37-9731-aeeef35b7e29', 'cd003ed0-6298-441c-a81b-3e1e087a712e', 'ecc33460-41ea-47b6-be39-31275fbcd91c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Delete snapshot completed successfully. Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-a7af7a40-1f13-4906-8715-5b2e9aaca629-delete_snapshot" released by "delete_snapshot" :: held 2.567s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-e67c6a5a-cb41-4111-b62b-264f6ecbe385-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-e67c6a5a-cb41-4111-b62b-264f6ecbe385-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-e67c6a5a-cb41-4111-b62b-264f6ecbe385" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-e67c6a5a-cb41-4111-b62b-264f6ecbe385" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Deleting offline snapshot e67c6a5a-cb41-4111-b62b-264f6ecbe385 of volume 10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:00:49 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] snapshot_file for this snap is: volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-825f5008-1747-41be-ac4a-76353e91d251" returned: 0 in 0.732s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-825f5008-1747-41be-ac4a-76353e91d251" released by "delete_volume" :: held 1.393s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f20ae4-1125-4088-bd26-477539999efa]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Created reservations ['c4ac39ce-15a5-4003-84d7-2f0e7b2543b5', 'ec15f9be-82bc-4395-9e2a-47aece2eae07', 'fe9c5a58-697e-4173-869c-af02fcc07f99', 'da510991-7687-492f-bcd4-e4c6786995bd'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:50 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:50 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:50 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 Nov 03 17:00:50 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:50 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.394s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:50 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Deleted volume successfully. Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3e19b9a-9f9b-41cd-85c2-634c42d8ecc2 tempest-VolumesGetTest-501723569 None] Lock "cinder-825f5008-1747-41be-ac4a-76353e91d251-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:50 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385" returned: 0 in 1.049s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10709bb2-d079-40ec-a8fd-b0e754d35f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[828cce3b-4aa8-4d2a-a3e7-008bc922ae9f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-2493485f-3708-4d3d-9a45-2684176b1681-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Lock "cinder-2493485f-3708-4d3d-9a45-2684176b1681-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=137,cinder:UPDATE=155,cinder:INSERT=40,cinder:DELETE=11 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Acquiring lock "cinder-quobyte-2493485f-3708-4d3d-9a45-2684176b1681" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-2493485f-3708-4d3d-9a45-2684176b1681" acquired by "delete_volume" :: waited 0.060s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:51 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 Nov 03 17:00:51 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[64863a0b-7d79-4b0d-a3a3-8911d53ce9c1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:51 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 Nov 03 17:00:51 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:52 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09" returned: 0 in 1.189s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:52 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 Nov 03 17:00:52 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:52 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681" returned: 0 in 0.928s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:52 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681 Nov 03 17:00:52 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:52 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2493485f-3708-4d3d-9a45-2684176b1681" returned: 0 in 0.597s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Lock "cinder-quobyte-2493485f-3708-4d3d-9a45-2684176b1681" released by "delete_volume" :: held 1.676s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=144,cinder:SELECT=141,cinder:DELETE=15,cinder:INSERT=38 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:00:53 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385" returned: 0 in 0.917s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Created reservations ['70f7a1c5-e5cb-47e5-b525-bb1f89b28eed', '57de5689-356c-4606-a14c-8f08e71eeccf', 'dffc93bd-4e89-451b-9030-a7a7ea38427a', '800eeea0-38af-49f3-bbd2-36577d5729db'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:53 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385 Nov 03 17:00:53 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:53 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:53 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:54 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09.e67c6a5a-cb41-4111-b62b-264f6ecbe385" returned: 0 in 0.953s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:54 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.735s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-e67c6a5a-cb41-4111-b62b-264f6ecbe385" released by "_delete_snapshot" :: held 4.462s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Deleted volume successfully. Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" released by "delete_snapshot" :: held 4.504s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd3715a1-55c0-40d9-8b8a-f098b644c0f2 tempest-VolumesGetTest-501723569 None] Lock "cinder-2493485f-3708-4d3d-9a45-2684176b1681-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Created reservations ['3e01f326-8c65-45ce-a988-7d8f346574c7', '6e3c0e4c-8eb7-467d-a8d9-5d11873148a0', '612806df-9b7c-4650-af6f-4ddac9bd2ca7', '4602e9f9-6393-4823-a207-a2e6f59f56b0'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Delete snapshot completed successfully. Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-e67c6a5a-cb41-4111-b62b-264f6ecbe385-delete_snapshot" released by "delete_snapshot" :: held 4.838s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Snapshots deleted, issuing volume delete {{(pid=86939) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47bad39-33ba-44bd-be19-7dd766c0991e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:54 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 Nov 03 17:00:54 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:55 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09" returned: 0 in 0.666s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:55 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09 Nov 03 17:00:55 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:55 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-10709bb2-d079-40ec-a8fd-b0e754d35f09" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-10709bb2-d079-40ec-a8fd-b0e754d35f09" released by "delete_volume" :: held 1.238s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:55 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Created reservations ['a405fd99-4201-4b8e-b0c1-098f72713c5e', '696183b4-73da-47eb-b9e6-1de54ad61695', '65e38e38-1d04-4658-bf33-eefca8e07cd4', '4b4c07d1-2bda-4827-b9ec-f05c9a8d1364'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:56 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:00:56 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:56 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.448s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:56 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Deleted volume successfully. Nov 03 17:00:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c8f49a6d-8c53-4911-ad9a-b4c33df5a76e tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-10709bb2-d079-40ec-a8fd-b0e754d35f09-delete_volume" released by "delete_volume" :: held 9.738s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Flow 'volume_create_manager' (b80b1799-940e-4ba9-9d4d-b98088c14940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7530af6d-5b97-44d9-808c-dc72e645ccf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7530af6d-5b97-44d9-808c-dc72e645ccf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1502075898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be52d5f1-2df4-4191-8609-67f9687feb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a7246df0e246fcb6f9e41b68de4cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:58Z,use_quota=True,user_id='0f6b6d60d7584fed875accf12e9de9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eb305e-3fec-4350-b63f-75be2d518ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eb305e-3fec-4350-b63f-75be2d518ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:58 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e464af25-7807-42ce-bae2-60c34f0b86f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e464af25-7807-42ce-bae2-60c34f0b86f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be52d5f1-2df4-4191-8609-67f9687feb8b', 'volume_name': 'volume-be52d5f1-2df4-4191-8609-67f9687feb8b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2699dd31-9fe5-4a55-bc2a-0fa755a48950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2699dd31-9fe5-4a55-bc2a-0fa755a48950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5687f33-5b0b-4047-bc19-56fb25b8f994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:58 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Volume be52d5f1-2df4-4191-8609-67f9687feb8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be52d5f1-2df4-4191-8609-67f9687feb8b', 'volume_size': 1} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9" returned: 0 in 9.745s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1, size 1024.00 MB, duration 9.75 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:00:58 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Converted 1024.00 MB image at 105.08 MB/s Nov 03 17:00:58 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:58 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 Nov 03 17:00:58 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:58 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9" returned: 0 in 0.255s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-2868ed3b-cb5f-4d33-b310-bf678634bac9" released by "_copy_volume_from_snapshot" :: held 10.984s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-f5563349-b0a6-4c54-b5a5-2e4b11552bd6-2868ed3b-cb5f-4d33-b310-bf678634bac9" released by "_create_volume_from_snapshot" :: held 11.091s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.123s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.309s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1502075898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be52d5f1-2df4-4191-8609-67f9687feb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a7246df0e246fcb6f9e41b68de4cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:58Z,use_quota=True,user_id='0f6b6d60d7584fed875accf12e9de9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Creating volume be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:58 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:00:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:58 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b 1073741824 Nov 03 17:00:58 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:58 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-32e481c9-98a1-46d8-b2c8-6c15c466e702 tempest-GroupSnapshotsTest-1875826730 None] Create group from source-snapshot-ae1c68e8-4fd3-4372-96cd-a11cddf9ca06 completed successfully. Nov 03 17:00:59 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b 1073741824" returned: 0 in 0.565s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:59 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b Nov 03 17:00:59 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-2868ed3b-cb5f-4d33-b310-bf678634bac9" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-2868ed3b-cb5f-4d33-b310-bf678634bac9" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d451f69e-bcd7-4bb2-8880-875d1e0097c9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:59 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b" returned: 0 in 0.287s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5687f33-5b0b-4047-bc19-56fb25b8f994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be52d5f1-2df4-4191-8609-67f9687feb8b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7a4511-0330-43e0-bfe7-a7508ccb9582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:59 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 Nov 03 17:00:59 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Volume volume-be52d5f1-2df4-4191-8609-67f9687feb8b (be52d5f1-2df4-4191-8609-67f9687feb8b): created successfully Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7a4511-0330-43e0-bfe7-a7508ccb9582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Flow 'volume_create_manager' (b80b1799-940e-4ba9-9d4d-b98088c14940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-38d73f3d-48db-486a-a742-69eb4098e699 tempest-VolumesDeleteCascade-651665537 None] Created volume successfully. Nov 03 17:00:59 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9" returned: 0 in 0.442s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:59 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9 Nov 03 17:00:59 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:59 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2868ed3b-cb5f-4d33-b310-bf678634bac9" returned: 0 in 0.282s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-2868ed3b-cb5f-4d33-b310-bf678634bac9" released by "delete_volume" :: held 0.796s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Flow 'volume_create_manager' (a25cf531-d715-4d35-840f-c31c2919001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa26b92-0033-493f-9607-621966af20fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa26b92-0033-493f-9607-621966af20fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-20608162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94168b90-9d6e-4f20-abd0-5e55e2073626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a361db981f4185a4b48d067e848e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:00Z,use_quota=True,user_id='491bb88eb93a4e86b6b481e067f47184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d021c05-3dfb-48da-96db-281ab00f7bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d021c05-3dfb-48da-96db-281ab00f7bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71b80ab-21b5-4d90-82b5-dc145ea193b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71b80ab-21b5-4d90-82b5-dc145ea193b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94168b90-9d6e-4f20-abd0-5e55e2073626', 'volume_name': 'volume-94168b90-9d6e-4f20-abd0-5e55e2073626', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcb66e3-ee82-4696-a0a2-fc24705ec1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcb66e3-ee82-4696-a0a2-fc24705ec1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b325594d-9f12-4900-aca9-9109c39a802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:00 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Volume 94168b90-9d6e-4f20-abd0-5e55e2073626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94168b90-9d6e-4f20-abd0-5e55e2073626', 'volume_size': 1} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-20608162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94168b90-9d6e-4f20-abd0-5e55e2073626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a361db981f4185a4b48d067e848e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:00Z,use_quota=True,user_id='491bb88eb93a4e86b6b481e067f47184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Creating volume 94168b90-9d6e-4f20-abd0-5e55e2073626 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:00 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:00 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 1073741824 Nov 03 17:01:00 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['13c7d3f4-cadf-418a-8a47-b26327836a35'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:00 devstack cinder-volume[86939]: WARNING cinder.quota [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-782034071 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-782034071, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:01:00 devstack cinder-volume[86939]: WARNING cinder.quota [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-782034071 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-782034071, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['79a378ed-16d3-4c54-8b55-0ba3a75dc28f', '35d890c3-d0bb-4af3-9703-fa579110f3cd', '99eaec3e-70f9-4ff3-adf2-73f19ce9b8c5', '26397429-b38d-4d0e-8b22-6b7c4f42516f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:00 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:00 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] group_snapshot ae1c68e8-4fd3-4372-96cd-a11cddf9ca06: deleting Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] group_snapshot ae1c68e8-4fd3-4372-96cd-a11cddf9ca06: deleting {{(pid=86939) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-a65942e0-1b5c-427d-a14a-c404fc310ce1" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-a65942e0-1b5c-427d-a14a-c404fc310ce1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-f5563349-b0a6-4c54-b5a5-2e4b11552bd6" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-f5563349-b0a6-4c54-b5a5-2e4b11552bd6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Deleting offline snapshot f5563349-b0a6-4c54-b5a5-2e4b11552bd6 of volume a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] snapshot_file for this snap is: volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8927b628-f5af-4e61-9cb1-2be97fbc276c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:00 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 1073741824" returned: 0 in 0.584s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:00 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:00 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.451s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:00 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:00 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-05ef4189-58e9-4c1e-8ef1-a721b4d01e46 tempest-GroupSnapshotsTest-1875826730 None] Delete group completed successfully. Nov 03 17:01:00 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 Nov 03 17:01:00 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:01 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626" returned: 0 in 0.341s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.932s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:01 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6" returned: 0 in 0.495s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a65942e0-1b5c-427d-a14a-c404fc310ce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b325594d-9f12-4900-aca9-9109c39a802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94168b90-9d6e-4f20-abd0-5e55e2073626', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99cc9b73-2a49-4a99-89a9-a4fa946e8fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b66ec7-b2e3-4fa0-9818-760ded87a3fd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Creating offline snapshot 1090d4e9-c0aa-4448-ad57-0bf716c78e9a of volume be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:01:01 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Volume volume-94168b90-9d6e-4f20-abd0-5e55e2073626 (94168b90-9d6e-4f20-abd0-5e55e2073626): created successfully Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99cc9b73-2a49-4a99-89a9-a4fa946e8fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Flow 'volume_create_manager' (a25cf531-d715-4d35-840f-c31c2919001b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e58a4bd-bfb5-4563-aea3-85a068eff4da]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-59eaf76f-5392-4495-9f3d-531d457ee9fa tempest-VolumesNegativeTest-1967170066 None] Created volume successfully. Nov 03 17:01:01 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 Nov 03 17:01:01 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:01 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b Nov 03 17:01:01 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:01 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b" returned: 0 in 0.457s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:01 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a 1G Nov 03 17:01:01 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:01 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1" returned: 0 in 0.626s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:01 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 Nov 03 17:01:01 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:02 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a 1G" returned: 0 in 0.558s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be52d5f1-2df4-4191-8609-67f9687feb8b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:02 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be52d5f1-2df4-4191-8609-67f9687feb8b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a Nov 03 17:01:02 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:02 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6" returned: 0 in 0.471s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:02 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6 Nov 03 17:01:02 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:02 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be52d5f1-2df4-4191-8609-67f9687feb8b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a" returned: 0 in 0.331s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:02 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a is being set with open permissions: ugo+rw Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:02 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1.f5563349-b0a6-4c54-b5a5-2e4b11552bd6" returned: 0 in 0.317s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:02 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a Nov 03 17:01:02 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-f5563349-b0a6-4c54-b5a5-2e4b11552bd6" released by "_delete_snapshot" :: held 2.056s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-a65942e0-1b5c-427d-a14a-c404fc310ce1" released by "delete_snapshot" :: held 2.090s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:02 devstack cinder-volume[86939]: WARNING cinder.quota [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-782034071 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-782034071, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['85bad9ac-a4db-4d54-bf3a-1193d8b03116', '41828070-daf0-4e55-92ba-7749b0ef4f8e', 'aabd85c1-e41c-417d-bd8e-ddbf5ab24594', 'af3a177f-6a4c-43e3-a78d-2f36c31a7bf5'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:02 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a" returned: 0 in 0.347s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:03 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-10be07a3-1295-4c76-8689-b842beba47fc tempest-GroupSnapshotsTest-1875826730 None] group_snapshot ae1c68e8-4fd3-4372-96cd-a11cddf9ca06: deleted successfully Nov 03 17:01:03 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.info Nov 03 17:01:03 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:03 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.info" returned: 0 in 0.306s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:03 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.info is being set with open permissions: ugo+rw Nov 03 17:01:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:03 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.info Nov 03 17:01:03 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:03 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.info" returned: 0 in 0.447s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.675s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:03 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e978011b-4489-4b88-a628-3fcc687a638a tempest-VolumesDeleteCascade-651665537 None] Create snapshot completed successfully Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Flow 'volume_create_manager' (015cd57e-33fa-41fe-89fa-1f61adb074bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17601b9c-ee7e-43a4-a9b2-7a303ad32be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17601b9c-ee7e-43a4-a9b2-7a303ad32be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1909378494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639f7bb2-41b8-40f1-87ce-47ca68cfe7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='613c4b7fe61b469390ce2f4696f58682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:04Z,use_quota=True,user_id='4a41a7a38c6b4b4a81673b31d158103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7c103a-d3a4-495e-a115-92d07fd94904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7c103a-d3a4-495e-a115-92d07fd94904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b64d62-b24e-422a-a289-89a3a0f027d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b64d62-b24e-422a-a289-89a3a0f027d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639f7bb2-41b8-40f1-87ce-47ca68cfe7ab', 'volume_name': 'volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bd6967-6e4f-4cdd-ab21-37584019ce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bd6967-6e4f-4cdd-ab21-37584019ce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff1a295-c599-478d-8fb1-c00037ff3311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:04 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Volume 639f7bb2-41b8-40f1-87ce-47ca68cfe7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab', 'volume_size': 1} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1909378494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639f7bb2-41b8-40f1-87ce-47ca68cfe7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='613c4b7fe61b469390ce2f4696f58682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:04Z,use_quota=True,user_id='4a41a7a38c6b4b4a81673b31d158103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Creating volume 639f7bb2-41b8-40f1-87ce-47ca68cfe7ab {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:04 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:04 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab 1073741824 Nov 03 17:01:04 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-a65942e0-1b5c-427d-a14a-c404fc310ce1" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-a65942e0-1b5c-427d-a14a-c404fc310ce1" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c69059-d034-409c-8c72-6a7f8d72d927]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:04 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 Nov 03 17:01:04 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:05 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1" returned: 0 in 0.636s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:05 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab 1073741824" returned: 0 in 0.830s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:05 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1 Nov 03 17:01:05 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Flow 'volume_create_manager' (54f9d8e5-fecc-4858-8283-00a67c8e23f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:05 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab Nov 03 17:01:05 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15f252c-50e6-483e-a3dc-1a43a4115290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15f252c-50e6-483e-a3dc-1a43a4115290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-333396997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6531d7-e4b9-4c82-954d-38d3b4e4c18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a7246df0e246fcb6f9e41b68de4cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1090d4e9-c0aa-4448-ad57-0bf716c78e9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:05Z,use_quota=True,user_id='0f6b6d60d7584fed875accf12e9de9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3822ddd-4a06-44fc-bab5-5b2814700289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3822ddd-4a06-44fc-bab5-5b2814700289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4937f128-c74a-4426-84b1-c7d0ca08e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4937f128-c74a-4426-84b1-c7d0ca08e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe6531d7-e4b9-4c82-954d-38d3b4e4c18b', 'volume_name': 'volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b', 'volume_size': 1, 'snapshot_id': '1090d4e9-c0aa-4448-ad57-0bf716c78e9a'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cc8bcb-94a4-4539-89d8-8c85d4a0f770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cc8bcb-94a4-4539-89d8-8c85d4a0f770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81e46c2-b912-429e-bb92-359f793135f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Volume fe6531d7-e4b9-4c82-954d-38d3b4e4c18b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b', 'volume_size': 1, 'snapshot_id': '1090d4e9-c0aa-4448-ad57-0bf716c78e9a'} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:05 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a65942e0-1b5c-427d-a14a-c404fc310ce1" returned: 0 in 0.337s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-a65942e0-1b5c-427d-a14a-c404fc310ce1" released by "delete_volume" :: held 1.086s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:05 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab" returned: 0 in 0.311s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.213s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-1090d4e9-c0aa-4448-ad57-0bf716c78e9a-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-1090d4e9-c0aa-4448-ad57-0bf716c78e9a-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Creating volume fe6531d7-e4b9-4c82-954d-38d3b4e4c18b from snapshot 1090d4e9-c0aa-4448-ad57-0bf716c78e9a {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff1a295-c599-478d-8fb1-c00037ff3311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a4fb4d-a4c5-4ebc-bfb4-b69b2df94285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['c02a6144-45c9-4681-ba4b-81f2379bc1f0'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] snapshot: 1090d4e9-c0aa-4448-ad57-0bf716c78e9a, volume: fe6531d7-e4b9-4c82-954d-38d3b4e4c18b, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:01:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Volume volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab (639f7bb2-41b8-40f1-87ce-47ca68cfe7ab): created successfully Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a4fb4d-a4c5-4ebc-bfb4-b69b2df94285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Flow 'volume_create_manager' (015cd57e-33fa-41fe-89fa-1f61adb074bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3fca04f9-5a6e-4ee3-b567-1a0d8812f70b tempest-AttachVolumeNegativeTest-454184678 None] Created volume successfully. Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d286db-ea35-4e46-be4c-354ac46c0820]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:05 devstack cinder-volume[86939]: WARNING cinder.db.api [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-782034071'] Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['c301a67f-bd25-4cde-b487-b907356b3868', '8d778379-ade0-4f42-9de3-886c4a09d4f2', '711e83b3-4620-41dc-b7d3-356be518f3ba', 'ad143515-4b83-4ca9-a602-d0aaaafbcbe4'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:06 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a Nov 03 17:01:06 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:06 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:06 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:06 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.357s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:06 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a" returned: 0 in 0.544s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be52d5f1-2df4-4191-8609-67f9687feb8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:01:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-80abf939-2e6a-476e-91d1-50b526e57f24 tempest-GroupSnapshotsTest-1875826730 None] Delete group completed successfully. Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a6a4d7-12cb-441e-843f-dccd601cce66]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:06 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b Nov 03 17:01:06 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:07 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b" returned: 0 in 0.511s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:01:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:01:07 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:01:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:07 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b Nov 03 17:01:07 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-90e8dbbf-d106-4daf-b86a-3745367f9748 tempest-GroupSnapshotsTest-1875826730 None] Group tempest-GroupSnapshotsTest-Group-1743007880: creating Nov 03 17:01:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-90e8dbbf-d106-4daf-b86a-3745367f9748 tempest-GroupSnapshotsTest-1875826730 None] Group tempest-GroupSnapshotsTest-Group-1743007880: created successfully Nov 03 17:01:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-90e8dbbf-d106-4daf-b86a-3745367f9748 tempest-GroupSnapshotsTest-1875826730 None] Create group completed successfully. Nov 03 17:01:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-8ab6d971-8c69-461a-8586-1b5fe3869c30 req-d819e60f-e50a-4bbc-a5c9-339b293bffe1 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Flow 'volume_create_manager' (9861a205-dc88-4097-b2af-8de2315146e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52f1e28-6126-4b13-9f15-915f0c63f14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52f1e28-6126-4b13-9f15-915f0c63f14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-103550357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7386b0e0-b39b-4e8c-a503-a7d39b3fbdf2,host='devstack@QuobyteHD#QuobyteHD',id=159c659a-4951-4fab-a091-d9d1bc87e437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713a4baa568c448f843d18fe99c5e06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:10Z,use_quota=True,user_id='657e3c414c2c40e88972d71512b533b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fba9db-f1e0-405c-9f46-1cb69002ba2e),volume_type_id=13fba9db-f1e0-405c-9f46-1cb69002ba2e)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c559e8e3-8db0-4620-981a-8e27cbc7b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c559e8e3-8db0-4620-981a-8e27cbc7b537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0478ba12-93f8-4e35-8477-730c3cb51fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0478ba12-93f8-4e35-8477-730c3cb51fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159c659a-4951-4fab-a091-d9d1bc87e437', 'volume_name': 'volume-159c659a-4951-4fab-a091-d9d1bc87e437', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014e0919-3961-4049-9212-b4f6dcc41640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014e0919-3961-4049-9212-b4f6dcc41640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b1b774-bbba-49d8-aa17-0e474e742139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Volume 159c659a-4951-4fab-a091-d9d1bc87e437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159c659a-4951-4fab-a091-d9d1bc87e437', 'volume_size': 1} Nov 03 17:01:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:17 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" returned: 0 in 10.141s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b, size 1024.00 MB, duration 10.14 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:01:17 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Converted 1024.00 MB image at 100.96 MB/s Nov 03 17:01:17 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b is being set with open permissions: ugo+rw Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:17 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b Nov 03 17:01:17 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:17 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" returned: 0 in 0.288s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" released by "_copy_volume_from_snapshot" :: held 11.626s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-1090d4e9-c0aa-4448-ad57-0bf716c78e9a-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" released by "_create_volume_from_snapshot" :: held 11.733s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.761s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-8ab6d971-8c69-461a-8586-1b5fe3869c30 req-d819e60f-e50a-4bbc-a5c9-339b293bffe1 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.956s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-8ab6d971-8c69-461a-8586-1b5fe3869c30 req-d819e60f-e50a-4bbc-a5c9-339b293bffe1 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.883s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7386b0e0-b39b-4e8c-a503-a7d39b3fbdf2,created_at=2026-11-03T16:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-103550357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7386b0e0-b39b-4e8c-a503-a7d39b3fbdf2,host='devstack@QuobyteHD#QuobyteHD',id=159c659a-4951-4fab-a091-d9d1bc87e437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713a4baa568c448f843d18fe99c5e06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:10Z,use_quota=True,user_id='657e3c414c2c40e88972d71512b533b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fba9db-f1e0-405c-9f46-1cb69002ba2e),volume_type_id=13fba9db-f1e0-405c-9f46-1cb69002ba2e)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Creating volume 159c659a-4951-4fab-a091-d9d1bc87e437 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:17 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81e46c2-b912-429e-bb92-359f793135f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b', 'volume_size': 1, 'snapshot_id': '1090d4e9-c0aa-4448-ad57-0bf716c78e9a'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:17 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 1073741824 Nov 03 17:01:17 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec839cc2-c9fa-4d0f-a0f5-3ccc1c437334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Volume volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b (fe6531d7-e4b9-4c82-954d-38d3b4e4c18b): created successfully Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec839cc2-c9fa-4d0f-a0f5-3ccc1c437334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Flow 'volume_create_manager' (54f9d8e5-fecc-4858-8283-00a67c8e23f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-8ab6d971-8c69-461a-8586-1b5fe3869c30 req-d819e60f-e50a-4bbc-a5c9-339b293bffe1 tempest-AttachVolumeNegativeTest-454184678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '789e9af8-db16-4779-97c5-88fd11a0a36c', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:01:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-04ea9dd3-43ee-48b1-8d4e-58367ca3f4dd tempest-VolumesDeleteCascade-651665537 None] Created volume successfully. Nov 03 17:01:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-8ab6d971-8c69-461a-8586-1b5fe3869c30 req-d819e60f-e50a-4bbc-a5c9-339b293bffe1 tempest-AttachVolumeNegativeTest-454184678 None] attachment_update completed successfully. Nov 03 17:01:18 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 1073741824" returned: 0 in 0.607s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:18 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 Nov 03 17:01:18 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:18 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437" returned: 0 in 0.299s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b1b774-bbba-49d8-aa17-0e474e742139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159c659a-4951-4fab-a091-d9d1bc87e437', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f9520c-cad4-4a8c-964e-efd61327e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Volume volume-159c659a-4951-4fab-a091-d9d1bc87e437 (159c659a-4951-4fab-a091-d9d1bc87e437): created successfully Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f9520c-cad4-4a8c-964e-efd61327e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Flow 'volume_create_manager' (9861a205-dc88-4097-b2af-8de2315146e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-67c48f75-ef8c-42ae-ad9b-bebfae40219e tempest-GroupSnapshotsTest-1875826730 None] Created volume successfully. Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-be52d5f1-2df4-4191-8609-67f9687feb8b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-be52d5f1-2df4-4191-8609-67f9687feb8b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Performing cascade delete. {{(pid=86939) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-1090d4e9-c0aa-4448-ad57-0bf716c78e9a-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-1090d4e9-c0aa-4448-ad57-0bf716c78e9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-be52d5f1-2df4-4191-8609-67f9687feb8b" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-be52d5f1-2df4-4191-8609-67f9687feb8b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-1090d4e9-c0aa-4448-ad57-0bf716c78e9a" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-1090d4e9-c0aa-4448-ad57-0bf716c78e9a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Deleting offline snapshot 1090d4e9-c0aa-4448-ad57-0bf716c78e9a of volume be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] snapshot_file for this snap is: volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1273c358-7b32-4a2f-81e1-65bdd7058804]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:19 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a Nov 03 17:01:19 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:19 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a" returned: 0 in 0.370s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be52d5f1-2df4-4191-8609-67f9687feb8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f10cc8f-74b9-4349-9697-5d4d0d914b0d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:19 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b Nov 03 17:01:19 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:20 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b" returned: 0 in 0.628s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:20 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a Nov 03 17:01:20 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:20 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a" returned: 0 in 0.537s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:20 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a Nov 03 17:01:20 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Flow 'volume_create_manager' (4d6ee9fc-720a-41c7-9453-136da1f7867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544c7fea-1127-4557-b538-50e8f953f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544c7fea-1127-4557-b538-50e8f953f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683417054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7386b0e0-b39b-4e8c-a503-a7d39b3fbdf2,host='devstack@QuobyteHD#QuobyteHD',id=a1cdee2d-20a2-468e-82cd-4a7a1d4893af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713a4baa568c448f843d18fe99c5e06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:21Z,use_quota=True,user_id='657e3c414c2c40e88972d71512b533b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fba9db-f1e0-405c-9f46-1cb69002ba2e),volume_type_id=13fba9db-f1e0-405c-9f46-1cb69002ba2e)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35c4c95-84f9-45ba-80fc-4b734abf58f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35c4c95-84f9-45ba-80fc-4b734abf58f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3774c6-e3aa-4c25-8dcb-6ba64efbfbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3774c6-e3aa-4c25-8dcb-6ba64efbfbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1cdee2d-20a2-468e-82cd-4a7a1d4893af', 'volume_name': 'volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a8ff70-d166-4976-868f-e57f987ef904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a8ff70-d166-4976-868f-e57f987ef904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdfc68d-26e5-4ac8-95a4-4713d79df44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:20 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Volume a1cdee2d-20a2-468e-82cd-4a7a1d4893af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af', 'volume_size': 1} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7386b0e0-b39b-4e8c-a503-a7d39b3fbdf2,created_at=2026-11-03T16:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683417054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7386b0e0-b39b-4e8c-a503-a7d39b3fbdf2,host='devstack@QuobyteHD#QuobyteHD',id=a1cdee2d-20a2-468e-82cd-4a7a1d4893af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713a4baa568c448f843d18fe99c5e06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:21Z,use_quota=True,user_id='657e3c414c2c40e88972d71512b533b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fba9db-f1e0-405c-9f46-1cb69002ba2e),volume_type_id=13fba9db-f1e0-405c-9f46-1cb69002ba2e)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Creating volume a1cdee2d-20a2-468e-82cd-4a7a1d4893af {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:21 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-11b84dc1-1a5e-4435-bd02-776c8b0687db req-b0131d95-befb-4c6f-aef0-ecdc9d2f1c82 tempest-AttachVolumeNegativeTest-454184678 None] Terminate volume connection completed successfully. Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-11b84dc1-1a5e-4435-bd02-776c8b0687db req-b0131d95-befb-4c6f-aef0-ecdc9d2f1c82 tempest-AttachVolumeNegativeTest-454184678 None] Deleting attachment 789e9af8-db16-4779-97c5-88fd11a0a36c. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:01:21 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af 1073741824 Nov 03 17:01:21 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:21 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b.1090d4e9-c0aa-4448-ad57-0bf716c78e9a" returned: 0 in 0.341s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-1090d4e9-c0aa-4448-ad57-0bf716c78e9a" released by "_delete_snapshot" :: held 1.993s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-be52d5f1-2df4-4191-8609-67f9687feb8b" released by "delete_snapshot" :: held 2.019s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Created reservations ['152f7a06-348f-4228-8bbb-2971202f6803', '25acab2f-b3da-4477-8427-6d4ff7164361', '275ad587-ad2b-436f-8dec-99230a457ed1', '460f32a0-5ddc-47b2-b441-51ea3f02dcdf'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Delete snapshot completed successfully. Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-1090d4e9-c0aa-4448-ad57-0bf716c78e9a-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Snapshots deleted, issuing volume delete {{(pid=86939) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-be52d5f1-2df4-4191-8609-67f9687feb8b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-be52d5f1-2df4-4191-8609-67f9687feb8b" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[52471dae-1338-4cda-9648-1256b4f958b5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:21 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b Nov 03 17:01:21 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:21 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af 1073741824" returned: 0 in 0.682s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:21 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af Nov 03 17:01:21 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:22 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b" returned: 0 in 0.572s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:22 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b Nov 03 17:01:22 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:22 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" returned: 0 in 0.429s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdfc68d-26e5-4ac8-95a4-4713d79df44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d349c5-4164-464b-b8a9-a4bcad8cc063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:22 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Volume volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af (a1cdee2d-20a2-468e-82cd-4a7a1d4893af): created successfully Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d349c5-4164-464b-b8a9-a4bcad8cc063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Flow 'volume_create_manager' (4d6ee9fc-720a-41c7-9453-136da1f7867d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3f80aedf-4f2a-4e67-b497-2f99b4c98396 tempest-GroupSnapshotsTest-1875826730 None] Created volume successfully. Nov 03 17:01:22 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be52d5f1-2df4-4191-8609-67f9687feb8b" returned: 0 in 0.540s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-be52d5f1-2df4-4191-8609-67f9687feb8b" released by "delete_volume" :: held 1.199s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Created reservations ['eadaa9a6-1150-4b71-bfbe-4f5c9b0e3ae7', 'c56bec96-7bb5-46dd-86de-238eae02ab0c', '25c4491d-ff37-45bc-a083-aa2696a66d36', 'b730a366-b062-4b30-a4ab-82e43240f668'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:22 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:22 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:23 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.320s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Deleted volume successfully. Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-737acafb-e944-4f3e-976f-406b130543a0 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-be52d5f1-2df4-4191-8609-67f9687feb8b-delete_volume" released by "delete_volume" :: held 4.102s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5db33b88-06d4-400d-b65d-ddb3452ce92a tempest-GroupSnapshotsTest-1875826730 None] Update group completed successfully. Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "cinder-quobyte-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" acquired by "delete_volume" :: waited 0.040s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8a7b62-7b77-4ec2-af15-d2e4a633cb7a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:24 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b Nov 03 17:01:24 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:24 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" returned: 0 in 0.452s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:24 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b Nov 03 17:01:24 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:24 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" returned: 0 in 0.266s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-quobyte-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b" released by "delete_volume" :: held 0.783s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Created reservations ['71d15a2b-8b31-4acb-b734-8464f70f6058', 'a7fa6312-be31-4a85-be78-ea20599c0ead', '976b814b-c05d-4623-aea4-17f967d8bf46', '8d309690-4f3d-4f03-9882-fdcc63d68e41'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4d1cfcd4-ea15-4435-bdde-72a8672bd381 tempest-GroupSnapshotsTest-1875826730 None] Update group completed successfully. Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:24 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:24 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:25 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.350s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:25 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Deleted volume successfully. Nov 03 17:01:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-538f2393-8805-4214-9a03-c1f0c09d27b9 tempest-VolumesDeleteCascade-651665537 None] Lock "cinder-fe6531d7-e4b9-4c82-954d-38d3b4e4c18b-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-aa58eccd-0ee3-4791-a077-9c938a8fa0aa tempest-GroupSnapshotsTest-1875826730 None] Update group completed successfully. Nov 03 17:01:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Acquiring lock "cinder-94168b90-9d6e-4f20-abd0-5e55e2073626-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Lock "cinder-94168b90-9d6e-4f20-abd0-5e55e2073626-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Acquiring lock "cinder-quobyte-94168b90-9d6e-4f20-abd0-5e55e2073626" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Lock "cinder-quobyte-94168b90-9d6e-4f20-abd0-5e55e2073626" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748c78f-8377-456d-812a-8f9df94f13da]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:27 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 Nov 03 17:01:27 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-883886d2-b451-457d-95f8-1dcc395cdeb7 tempest-GroupSnapshotsTest-1875826730 None] Update group completed successfully. Nov 03 17:01:27 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626" returned: 0 in 0.460s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:27 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626 Nov 03 17:01:27 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:27 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-94168b90-9d6e-4f20-abd0-5e55e2073626" returned: 0 in 0.300s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Lock "cinder-quobyte-94168b90-9d6e-4f20-abd0-5e55e2073626" released by "delete_volume" :: held 0.855s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Created reservations ['c6519f41-02bf-486f-9825-868a80bf83dd', 'f398eeae-0101-484f-8c05-405e0dad19c1', '96854013-7b9d-4ac8-b22f-f6738ec2bb56', 'b3f04070-3b8e-45d4-a0e6-4c426664a22c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:28 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:28 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:28 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.301s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Deleted volume successfully. Nov 03 17:01:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c44f1d76-358e-478e-8e29-600b8dd89601 tempest-VolumesNegativeTest-1967170066 None] Lock "cinder-94168b90-9d6e-4f20-abd0-5e55e2073626-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] GroupSnapshot 8df20439-4d1a-4f22-9851-f6e76a9d5f6c: creating. Nov 03 17:01:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Group snapshot 8df20439-4d1a-4f22-9851-f6e76a9d5f6c: creating. {{(pid=86939) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:01:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Creating offline snapshot 28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 of volume 159c659a-4951-4fab-a091-d9d1bc87e437 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:01:29 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07721c2-3609-4c08-b94c-6e2a9fcb11a6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:29 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 Nov 03 17:01:29 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:29 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437" returned: 0 in 0.463s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:29 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 1G Nov 03 17:01:29 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:30 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 1G" returned: 0 in 0.618s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159c659a-4951-4fab-a091-d9d1bc87e437 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:30 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159c659a-4951-4fab-a091-d9d1bc87e437 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 Nov 03 17:01:30 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:30 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159c659a-4951-4fab-a091-d9d1bc87e437 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7" returned: 0 in 0.371s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:30 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:30 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 Nov 03 17:01:30 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:30 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:30 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:30 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7" returned: 0 in 0.363s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:31 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.info Nov 03 17:01:31 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:31 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.398s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:01:31 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.info" returned: 0 in 0.435s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:31 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:31 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.info Nov 03 17:01:31 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:31 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.info" returned: 0 in 0.377s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Creating offline snapshot b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 of volume a1cdee2d-20a2-468e-82cd-4a7a1d4893af {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[494518e1-d712-4bec-8512-1d91daea63d6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:32 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af Nov 03 17:01:32 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Flow 'volume_create_manager' (675f3f9e-90e3-45f8-a60f-c036af778646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d3df90-164b-4346-a224-b2d08a0ed0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d3df90-164b-4346-a224-b2d08a0ed0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-121358584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331a3707-eceb-4184-b38b-146b06a956cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04e9b5ca15b4e75bac9fbe4c4386049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:32Z,use_quota=True,user_id='b566b82572914a7ebc3444ae86daf1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223517fa-b29b-481c-b6a0-53610aeacb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223517fa-b29b-481c-b6a0-53610aeacb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b2b54b-3396-498c-a2f9-98d3a5b808e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b2b54b-3396-498c-a2f9-98d3a5b808e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331a3707-eceb-4184-b38b-146b06a956cf', 'volume_name': 'volume-331a3707-eceb-4184-b38b-146b06a956cf', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa701b1-203e-4bdb-b3f8-476bd1aa53c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa701b1-203e-4bdb-b3f8-476bd1aa53c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33c7fa1-3cdf-4e3c-a03b-e95b4185b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:32 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Volume 331a3707-eceb-4184-b38b-146b06a956cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331a3707-eceb-4184-b38b-146b06a956cf', 'volume_size': 1} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:32 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" returned: 0 in 0.681s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:32 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 1G Nov 03 17:01:32 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:33 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 1G" returned: 0 in 0.560s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:33 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 Nov 03 17:01:33 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:33 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49" returned: 0 in 0.392s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:33 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:01:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:33 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 Nov 03 17:01:33 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:33 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49" returned: 0 in 0.334s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:33 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.info Nov 03 17:01:33 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:34 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.info" returned: 0 in 0.282s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:34 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:34 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.info Nov 03 17:01:34 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:34 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.info" returned: 0 in 0.307s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-121358584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331a3707-eceb-4184-b38b-146b06a956cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04e9b5ca15b4e75bac9fbe4c4386049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:32Z,use_quota=True,user_id='b566b82572914a7ebc3444ae86daf1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Creating volume 331a3707-eceb-4184-b38b-146b06a956cf {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:34 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:01:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:34 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf 1073741824 Nov 03 17:01:34 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b27f6a9b-707f-45e1-844a-7d056ce27f5b tempest-GroupSnapshotsTest-1875826730 None] group_snapshot 8df20439-4d1a-4f22-9851-f6e76a9d5f6c: created successfully Nov 03 17:01:35 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf 1073741824" returned: 0 in 0.859s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:35 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf Nov 03 17:01:35 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:35 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] group_snapshot 8df20439-4d1a-4f22-9851-f6e76a9d5f6c: deleting Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] group_snapshot 8df20439-4d1a-4f22-9851-f6e76a9d5f6c: deleting {{(pid=86939) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-159c659a-4951-4fab-a091-d9d1bc87e437" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-159c659a-4951-4fab-a091-d9d1bc87e437" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:36 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Deleting offline snapshot 28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 of volume 159c659a-4951-4fab-a091-d9d1bc87e437 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] snapshot_file for this snap is: volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf" returned: 0 in 0.781s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9726eeb5-7044-48bb-8bcb-00f33eda26c4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33c7fa1-3cdf-4e3c-a03b-e95b4185b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331a3707-eceb-4184-b38b-146b06a956cf', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3955d5f1-7ea5-4786-aa11-54356e60fb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:36 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Volume volume-331a3707-eceb-4184-b38b-146b06a956cf (331a3707-eceb-4184-b38b-146b06a956cf): created successfully Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3955d5f1-7ea5-4786-aa11-54356e60fb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Flow 'volume_create_manager' (675f3f9e-90e3-45f8-a60f-c036af778646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-aa3c4950-bd15-48ff-884a-ce4883393357 tempest-VolumesTransfersTest-472728509 None] Created volume successfully. Nov 03 17:01:36 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 Nov 03 17:01:36 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:36 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7" returned: 0 in 0.580s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159c659a-4951-4fab-a091-d9d1bc87e437(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[11167bb0-fc65-4cdc-96bb-297e280fe00e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:37 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 Nov 03 17:01:37 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:37 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437" returned: 0 in 0.568s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:37 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 Nov 03 17:01:37 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:37 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-eda2f2e9-3df1-4173-a6f3-978ce5cc7e12 tempest-VolumesTransfersTest-1774560908 None] Transfer volume completed successfully. Nov 03 17:01:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7" returned: 0 in 0.453s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:38 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7 Nov 03 17:01:38 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:38 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437.28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7" returned: 0 in 0.388s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-28ba5e1a-2267-42e2-a3b4-7e9a3fd6e0e7" released by "_delete_snapshot" :: held 2.246s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-159c659a-4951-4fab-a091-d9d1bc87e437" released by "delete_snapshot" :: held 2.314s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Deleting offline snapshot b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 of volume a1cdee2d-20a2-468e-82cd-4a7a1d4893af {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] snapshot_file for this snap is: volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb18024d-4641-45a2-800a-dc48b13a09b5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:38 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 Nov 03 17:01:38 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Acquiring lock "cinder-331a3707-eceb-4184-b38b-146b06a956cf-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Lock "cinder-331a3707-eceb-4184-b38b-146b06a956cf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Acquiring lock "cinder-quobyte-331a3707-eceb-4184-b38b-146b06a956cf" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Lock "cinder-quobyte-331a3707-eceb-4184-b38b-146b06a956cf" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02f8abe-d167-4a8a-8d07-37f24ebe48ba]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:39 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49" returned: 0 in 0.740s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bbfb24-340d-48a2-92d2-2965dcaa8d9a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:39 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf Nov 03 17:01:39 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:39 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af Nov 03 17:01:39 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:40 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" returned: 0 in 0.606s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:40 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf" returned: 0 in 0.787s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:40 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 Nov 03 17:01:40 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:40 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf Nov 03 17:01:40 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:40 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-331a3707-eceb-4184-b38b-146b06a956cf" returned: 0 in 0.537s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Lock "cinder-quobyte-331a3707-eceb-4184-b38b-146b06a956cf" released by "delete_volume" :: held 1.433s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:40 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49" returned: 0 in 0.758s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:40 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Created reservations ['7226803e-0517-4860-afa2-d95f0d64c7e7', '7af49ec4-6f6c-43c7-8641-4c0235dd7ff1', 'b4170f98-ee81-49d3-a038-dae4b7f1a6ed', '7d247f42-be35-41e2-9703-38dfc0580f05'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:40 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49 Nov 03 17:01:40 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:41 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:41 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:41 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af.b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49" returned: 0 in 0.501s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-b8bc5e66-d5c4-4b3b-9213-61bdfc41dc49" released by "_delete_snapshot" :: held 2.852s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" released by "delete_snapshot" :: held 2.904s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:41 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.529s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:41 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1168532219 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1168532219, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:01:41 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1168532219 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1168532219, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Deleted volume successfully. Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['d405b84d-cfbc-46a8-b46e-b6affbe70d55', 'f3b9b99c-2b83-4f32-916c-8a552f2cbc67', '6f0fde8b-a984-4fbb-bbba-0bbfef058b92', '3ff7ac73-5e14-4606-8cec-420a2ac5ae35'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9decea63-5189-4939-b2af-e7e79c14cdfd tempest-VolumesTransfersTest-1826888395 None] Lock "cinder-331a3707-eceb-4184-b38b-146b06a956cf-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['f3fe46b3-78a0-4647-9a1e-58e8bcaee7ce', '22498ff5-44a8-4d84-9e0e-b8a836068af8', '2fc34b14-0051-4f53-8c81-19160f807292', '092a28c5-e525-4e70-afd5-e5bcb4811c67'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0294cbc6-fb0b-4c15-80a4-d9e95f41841a tempest-GroupSnapshotsTest-1875826730 None] group_snapshot 8df20439-4d1a-4f22-9851-f6e76a9d5f6c: deleted successfully Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Flow 'volume_create_manager' (29c0dcbf-659b-453d-bad0-05fd5d167baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7f7c45-324b-4def-8ee3-48b8acccbdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7f7c45-324b-4def-8ee3-48b8acccbdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1308704240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a037c16-a538-483d-8343-d1eab7f02579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04e9b5ca15b4e75bac9fbe4c4386049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:43Z,use_quota=True,user_id='b566b82572914a7ebc3444ae86daf1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07397008-b3f1-43e1-ba73-df25e568a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07397008-b3f1-43e1-ba73-df25e568a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9701983f-3f9c-4b3f-9df9-afa952a79551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9701983f-3f9c-4b3f-9df9-afa952a79551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a037c16-a538-483d-8343-d1eab7f02579', 'volume_name': 'volume-2a037c16-a538-483d-8343-d1eab7f02579', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ff296-b243-4e7a-a9f7-8e84d78fe20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ff296-b243-4e7a-a9f7-8e84d78fe20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b848a5-88f4-4e45-b551-2d72ef8571de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:42 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Volume 2a037c16-a538-483d-8343-d1eab7f02579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a037c16-a538-483d-8343-d1eab7f02579', 'volume_size': 1} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1308704240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a037c16-a538-483d-8343-d1eab7f02579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04e9b5ca15b4e75bac9fbe4c4386049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:43Z,use_quota=True,user_id='b566b82572914a7ebc3444ae86daf1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Creating volume 2a037c16-a538-483d-8343-d1eab7f02579 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:42 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:01:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:42 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 1073741824 Nov 03 17:01:42 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-159c659a-4951-4fab-a091-d9d1bc87e437" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-159c659a-4951-4fab-a091-d9d1bc87e437" acquired by "delete_volume" :: waited 0.045s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e4b75-554a-40b9-be68-aa2586b98cda]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:43 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 Nov 03 17:01:43 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:43 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437" returned: 0 in 0.557s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:43 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437 Nov 03 17:01:43 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:43 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 1073741824" returned: 0 in 0.982s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:44 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 Nov 03 17:01:44 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:44 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-159c659a-4951-4fab-a091-d9d1bc87e437" returned: 0 in 0.420s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-159c659a-4951-4fab-a091-d9d1bc87e437" released by "delete_volume" :: held 1.141s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe56cc8-ba34-4885-a8ee-7b8314caf48d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:44 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579" returned: 0 in 0.435s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b848a5-88f4-4e45-b551-2d72ef8571de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a037c16-a538-483d-8343-d1eab7f02579', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7b25f1-da59-4b13-955e-0e131448857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Volume volume-2a037c16-a538-483d-8343-d1eab7f02579 (2a037c16-a538-483d-8343-d1eab7f02579): created successfully Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7b25f1-da59-4b13-955e-0e131448857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:44 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af Nov 03 17:01:44 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Flow 'volume_create_manager' (29c0dcbf-659b-453d-bad0-05fd5d167baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4ee62f4c-946c-450f-b498-486ad3fdd4f6 tempest-VolumesTransfersTest-472728509 None] Created volume successfully. Nov 03 17:01:45 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" returned: 0 in 0.749s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:45 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af Nov 03 17:01:45 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Acquiring lock "cinder-2a037c16-a538-483d-8343-d1eab7f02579-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Lock "cinder-2a037c16-a538-483d-8343-d1eab7f02579-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Acquiring lock "cinder-quobyte-2a037c16-a538-483d-8343-d1eab7f02579" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Lock "cinder-quobyte-2a037c16-a538-483d-8343-d1eab7f02579" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:45 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" returned: 0 in 0.459s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dcae7d-bb8e-4e7f-ba5e-eb54bb9a39af]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-a1cdee2d-20a2-468e-82cd-4a7a1d4893af" released by "delete_volume" :: held 1.325s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['c46fa3bc-9ab8-45ca-8f5a-fc09ebc6767e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:45 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 Nov 03 17:01:45 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:45 devstack cinder-volume[86939]: WARNING cinder.quota [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1168532219 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1168532219, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:01:45 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['a821c1c5-cd7f-4144-b8f7-6027ab71bbc6', '889aab31-08e1-41ad-8699-a0ad63fbed6e', '33077a77-5aea-4b32-9715-b27cf9ffbc6e', '45dfed66-6b3c-4153-92e6-b2239e310092'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['278e654a-b0f0-45a7-8533-d4b629be8bd6', '980fc659-0daf-4737-9be4-5ce9052a858b', '8df6aae6-3cc9-45cd-b9ad-d0dc1d057706', '3f186681-7737-466a-bd12-ebfdea50ae12'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:46 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579" returned: 0 in 0.750s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:46 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579 Nov 03 17:01:46 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:46 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:46 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:46 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a037c16-a538-483d-8343-d1eab7f02579" returned: 0 in 0.490s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Lock "cinder-quobyte-2a037c16-a538-483d-8343-d1eab7f02579" released by "delete_volume" :: held 1.347s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:47 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.478s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Created reservations ['d7b18d03-cb38-4377-a24b-12517659eeb5', '56b6efaa-4383-4152-87a6-11726011f2b0', 'd1482e5a-1ddf-4fd8-87ed-86a816b7c17e', '02eb73cc-1516-405f-ab07-89131ebe565c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d9b059d0-8ac3-44a0-9141-e329fff65081 tempest-GroupSnapshotsTest-1875826730 None] Delete group completed successfully. Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:47 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:01:47 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:47 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.482s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Deleted volume successfully. Nov 03 17:01:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-531d9271-ed08-454c-96bc-319a735553ff tempest-VolumesTransfersTest-1826888395 None] Lock "cinder-2a037c16-a538-483d-8343-d1eab7f02579-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:48 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1a98da78-9dcc-4006-80c3-dea123a9e747 tempest-GroupSnapshotsTest-1875826730 None] Group tempest-GroupSnapshotsTest-Group-714577508: creating Nov 03 17:01:48 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1a98da78-9dcc-4006-80c3-dea123a9e747 tempest-GroupSnapshotsTest-1875826730 None] Group tempest-GroupSnapshotsTest-Group-714577508: created successfully Nov 03 17:01:48 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1a98da78-9dcc-4006-80c3-dea123a9e747 tempest-GroupSnapshotsTest-1875826730 None] Create group completed successfully. Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Flow 'volume_create_manager' (84cd1c02-90b7-4f95-9a33-17e61812a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31c37fd-eaa6-4aed-9596-7187aa46a42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31c37fd-eaa6-4aed-9596-7187aa46a42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-412123294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ef99fd8-0609-43d6-96b3-70bada5d3aa2,host='devstack@QuobyteHD#QuobyteHD',id=1ace3a40-b7a8-47c9-b122-e6676179ba79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713a4baa568c448f843d18fe99c5e06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:50Z,use_quota=True,user_id='657e3c414c2c40e88972d71512b533b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1607e2da-535e-46c4-a479-cfc0a72ca63d),volume_type_id=1607e2da-535e-46c4-a479-cfc0a72ca63d)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e732a10-5660-483e-90fc-5cf4faad0497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e732a10-5660-483e-90fc-5cf4faad0497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64d06f5-7b31-4189-80f6-c5b00b5c73f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64d06f5-7b31-4189-80f6-c5b00b5c73f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ace3a40-b7a8-47c9-b122-e6676179ba79', 'volume_name': 'volume-1ace3a40-b7a8-47c9-b122-e6676179ba79', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd0ea97-4e33-4734-95e1-adc1a58c3a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd0ea97-4e33-4734-95e1-adc1a58c3a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408973b1-a27a-48a3-b1ac-c5ac18899692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:50 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Volume 1ace3a40-b7a8-47c9-b122-e6676179ba79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ace3a40-b7a8-47c9-b122-e6676179ba79', 'volume_size': 1} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5ef99fd8-0609-43d6-96b3-70bada5d3aa2,created_at=2026-11-03T16:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-412123294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ef99fd8-0609-43d6-96b3-70bada5d3aa2,host='devstack@QuobyteHD#QuobyteHD',id=1ace3a40-b7a8-47c9-b122-e6676179ba79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713a4baa568c448f843d18fe99c5e06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:50Z,use_quota=True,user_id='657e3c414c2c40e88972d71512b533b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1607e2da-535e-46c4-a479-cfc0a72ca63d),volume_type_id=1607e2da-535e-46c4-a479-cfc0a72ca63d)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Creating volume 1ace3a40-b7a8-47c9-b122-e6676179ba79 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:50 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:50 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 1073741824 Nov 03 17:01:50 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:50 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 1073741824" returned: 0 in 0.576s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:50 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 Nov 03 17:01:50 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:51 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79" returned: 0 in 0.342s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408973b1-a27a-48a3-b1ac-c5ac18899692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ace3a40-b7a8-47c9-b122-e6676179ba79', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ea8592-40dc-49c5-a658-9e33421d1762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:51 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Volume volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 (1ace3a40-b7a8-47c9-b122-e6676179ba79): created successfully Nov 03 17:01:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ea8592-40dc-49c5-a658-9e33421d1762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Flow 'volume_create_manager' (84cd1c02-90b7-4f95-9a33-17e61812a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:51 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ad1919cc-6c2d-4a12-a70f-a1b52eabee7d tempest-GroupSnapshotsTest-1875826730 None] Created volume successfully. Nov 03 17:01:52 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] GroupSnapshot fa25f739-c5ac-4944-9b67-73e7c71c568f: creating. Nov 03 17:01:52 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=153,cinder:INSERT=43,cinder:UPDATE=161,cinder:DELETE=6 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:01:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Group snapshot fa25f739-c5ac-4944-9b67-73e7c71c568f: creating. {{(pid=86939) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:01:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Creating offline snapshot 427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 of volume 1ace3a40-b7a8-47c9-b122-e6676179ba79 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:01:52 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[30190af3-a828-4491-aba9-f1512dbf1cf4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:52 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 Nov 03 17:01:52 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:53 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79" returned: 0 in 0.425s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:53 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 1G Nov 03 17:01:53 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:53 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 1G" returned: 0 in 0.474s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:53 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 Nov 03 17:01:53 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:54 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:54 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:01:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:54 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 Nov 03 17:01:54 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:54 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32" returned: 0 in 0.334s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:54 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:INSERT=37,cinder:UPDATE=173,cinder:SELECT=140,cinder:DELETE=11 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:01:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:54 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.info Nov 03 17:01:54 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:54 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.info" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:54 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:01:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:54 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.info Nov 03 17:01:54 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:54 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.info" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:55 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f2f14cf0-bb03-428f-9dfd-e748235bda50 tempest-GroupSnapshotsTest-1875826730 None] group_snapshot fa25f739-c5ac-4944-9b67-73e7c71c568f: created successfully Nov 03 17:01:56 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] group_snapshot fa25f739-c5ac-4944-9b67-73e7c71c568f: deleting Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] group_snapshot fa25f739-c5ac-4944-9b67-73e7c71c568f: deleting {{(pid=86939) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-1ace3a40-b7a8-47c9-b122-e6676179ba79" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-1ace3a40-b7a8-47c9-b122-e6676179ba79" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-427f2d53-3bc2-4b85-9c42-dd7e4bf41d32" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-427f2d53-3bc2-4b85-9c42-dd7e4bf41d32" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Deleting offline snapshot 427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 of volume 1ace3a40-b7a8-47c9-b122-e6676179ba79 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] snapshot_file for this snap is: volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266e7ba-8367-42e3-8208-505eca9446c6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:56 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 Nov 03 17:01:56 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:57 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32" returned: 0 in 0.604s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ace3a40-b7a8-47c9-b122-e6676179ba79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:01:57 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f2c34-a8ec-488a-8a92-2a67704d70ce]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:57 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 Nov 03 17:01:57 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:57 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79" returned: 0 in 0.656s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:57 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 Nov 03 17:01:57 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:58 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32" returned: 0 in 0.733s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:58 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32 Nov 03 17:01:58 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Flow 'volume_create_manager' (445d111e-e0e1-49e8-b58f-891d67b4d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f030e00-f7f9-4a4e-a7ee-ca12f2ef5892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f030e00-f7f9-4a4e-a7ee-ca12f2ef5892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1322097028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7f20d7-ff70-42d9-afe8-db211345a211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8020ceb2d2754ba88419da8677e829b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:59Z,use_quota=True,user_id='e80349d08b3648929ab76d731bd7b3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b412b18-101c-4396-af57-6ab8e5627b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b412b18-101c-4396-af57-6ab8e5627b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c1be8d-713a-4df1-bfd6-7a463ccf16d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c1be8d-713a-4df1-bfd6-7a463ccf16d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7f20d7-ff70-42d9-afe8-db211345a211', 'volume_name': 'volume-4b7f20d7-ff70-42d9-afe8-db211345a211', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b754ce93-0d5e-4b77-bd4f-ca01e451d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b754ce93-0d5e-4b77-bd4f-ca01e451d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:58 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13361b62-2f28-4ae6-9f30-07a8aae63a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:58 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Volume 4b7f20d7-ff70-42d9-afe8-db211345a211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7f20d7-ff70-42d9-afe8-db211345a211', 'volume_size': 1} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1322097028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7f20d7-ff70-42d9-afe8-db211345a211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8020ceb2d2754ba88419da8677e829b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:59Z,use_quota=True,user_id='e80349d08b3648929ab76d731bd7b3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Creating volume 4b7f20d7-ff70-42d9-afe8-db211345a211 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:58 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79.427f2d53-3bc2-4b85-9c42-dd7e4bf41d32" returned: 0 in 0.398s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:58 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 1073741824 Nov 03 17:01:58 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-427f2d53-3bc2-4b85-9c42-dd7e4bf41d32" released by "_delete_snapshot" :: held 2.638s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-1ace3a40-b7a8-47c9-b122-e6676179ba79" released by "delete_snapshot" :: held 2.678s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:59 devstack cinder-volume[86939]: WARNING cinder.quota [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1315861842 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1315861842, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:01:59 devstack cinder-volume[86939]: WARNING cinder.quota [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1315861842 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1315861842, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['2f96382f-11d5-471e-8dba-782e9718cf1f', '1e5415b3-170f-42a9-859b-3e57487b0a5d', 'f9c22f01-9e67-464c-9091-197a900eb2f2', '0ea1e97a-126f-4511-a63d-c3c07ae14a9b'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e5712e13-bd1c-4014-bbd9-2138071de4d8 tempest-GroupSnapshotsTest-1875826730 None] group_snapshot fa25f739-c5ac-4944-9b67-73e7c71c568f: deleted successfully Nov 03 17:01:59 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 1073741824" returned: 0 in 0.558s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:59 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 Nov 03 17:01:59 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:59 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211" returned: 0 in 0.296s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13361b62-2f28-4ae6-9f30-07a8aae63a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7f20d7-ff70-42d9-afe8-db211345a211', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45a45f02-5082-451d-b7c7-5503ccc4036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Volume volume-4b7f20d7-ff70-42d9-afe8-db211345a211 (4b7f20d7-ff70-42d9-afe8-db211345a211): created successfully Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45a45f02-5082-451d-b7c7-5503ccc4036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Flow 'volume_create_manager' (445d111e-e0e1-49e8-b58f-891d67b4d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a585142a-84e1-46ea-978d-1d8fe67f68ae tempest-VolumesTransfersV355Test-2095176879 None] Created volume successfully. Nov 03 17:02:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "cinder-quobyte-1ace3a40-b7a8-47c9-b122-e6676179ba79" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-1ace3a40-b7a8-47c9-b122-e6676179ba79" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:00 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be256e-e733-450a-9b33-c8d13a07c4f5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:00 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 Nov 03 17:02:00 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:00 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79" returned: 0 in 0.455s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:00 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79 Nov 03 17:02:00 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:01 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1ace3a40-b7a8-47c9-b122-e6676179ba79" returned: 0 in 0.357s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Lock "cinder-quobyte-1ace3a40-b7a8-47c9-b122-e6676179ba79" released by "delete_volume" :: held 0.917s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['8158385f-5ab1-462a-943a-3d0501859aed'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:01 devstack cinder-volume[86939]: WARNING cinder.quota [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1315861842 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1315861842, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Created reservations ['4b21bfe2-a626-44d8-9c60-8e0055a9ee0d', '752c7d42-b0f9-47ae-9e81-67a78fbe217d', '152de5a2-fc2a-40a9-9e6d-2207e750681f', 'c81d5166-37ad-4d37-8a62-4704c1e4eb94'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:01 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:01 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-da510925-e713-471d-b09c-e9529c25f767 tempest-VolumesTransfersV355Test-155282971 None] Transfer volume completed successfully. Nov 03 17:02:01 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.356s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:01 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7b6cb4c0-80a0-481e-b291-3b23f5bf2207 tempest-GroupSnapshotsTest-1875826730 None] Delete group completed successfully. Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Flow 'volume_create_manager' (2a7a09a4-62cc-401e-b3db-25974fc395ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c3ac40-63ae-427a-b9a7-2d599c610cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c3ac40-63ae-427a-b9a7-2d599c610cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1720425837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e562f70-fecd-459f-9b0d-3c96da9cd35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='613c4b7fe61b469390ce2f4696f58682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:02Z,use_quota=True,user_id='4a41a7a38c6b4b4a81673b31d158103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febef40e-d5c2-4b1f-90e9-7e6366f898e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febef40e-d5c2-4b1f-90e9-7e6366f898e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd352c7d-2204-4a43-904e-e8e0e271b6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd352c7d-2204-4a43-904e-e8e0e271b6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e562f70-fecd-459f-9b0d-3c96da9cd35a', 'volume_name': 'volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3599ce6-10a4-41a1-9673-c7c31008840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3599ce6-10a4-41a1-9673-c7c31008840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebbb611-c3c2-4b31-85b3-eb8ef273b428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:02 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Volume 3e562f70-fecd-459f-9b0d-3c96da9cd35a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a', 'volume_size': 1} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1720425837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e562f70-fecd-459f-9b0d-3c96da9cd35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='613c4b7fe61b469390ce2f4696f58682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:02Z,use_quota=True,user_id='4a41a7a38c6b4b4a81673b31d158103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Creating volume 3e562f70-fecd-459f-9b0d-3c96da9cd35a {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:02 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:02 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a 1073741824 Nov 03 17:02:02 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Acquiring lock "cinder-4b7f20d7-ff70-42d9-afe8-db211345a211-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Lock "cinder-4b7f20d7-ff70-42d9-afe8-db211345a211-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Acquiring lock "cinder-quobyte-4b7f20d7-ff70-42d9-afe8-db211345a211" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Lock "cinder-quobyte-4b7f20d7-ff70-42d9-afe8-db211345a211" acquired by "delete_volume" :: waited 0.042s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[003dba3e-5c8b-458f-be00-39e8d91f62bf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:02 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a 1073741824" returned: 0 in 0.662s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:02 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 Nov 03 17:02:02 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:02 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a Nov 03 17:02:02 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:03 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211" returned: 0 in 0.487s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:03 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211 Nov 03 17:02:03 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:03 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a" returned: 0 in 0.363s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebbb611-c3c2-4b31-85b3-eb8ef273b428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f662a9-a345-41dd-9c53-e3a3622cf816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:03 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Volume volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a (3e562f70-fecd-459f-9b0d-3c96da9cd35a): created successfully Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f662a9-a345-41dd-9c53-e3a3622cf816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Flow 'volume_create_manager' (2a7a09a4-62cc-401e-b3db-25974fc395ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:03 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3107b778-d345-4217-8399-4d5a092cf4c2 tempest-AttachVolumeNegativeTest-454184678 None] Created volume successfully. Nov 03 17:02:03 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4b7f20d7-ff70-42d9-afe8-db211345a211" returned: 0 in 0.315s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Lock "cinder-quobyte-4b7f20d7-ff70-42d9-afe8-db211345a211" released by "delete_volume" :: held 0.866s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Created reservations ['ca972729-0a1b-4836-aaf9-dfbb8618560c', 'bad43846-c28c-4f62-9036-6786d52e0512', 'ceab6f3a-2324-46d8-b7d9-a9820f6beb44', 'b88bbbb6-4a37-4124-84e5-e8be9d0f6e4c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:03 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:03 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:04 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.399s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:04 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Deleted volume successfully. Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-131f9037-9594-4216-b2f4-65b62e6fd1dd tempest-VolumesTransfersV355Test-1210595358 None] Lock "cinder-4b7f20d7-ff70-42d9-afe8-db211345a211-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Flow 'volume_create_manager' (73fcb010-f072-45e7-a4a3-7685ddb5ea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16168a9-5606-4bc0-bf3f-96fb60378fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16168a9-5606-4bc0-bf3f-96fb60378fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-806652847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e38430c-4dd9-4d36-80ae-cb29d52a32fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8020ceb2d2754ba88419da8677e829b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:05Z,use_quota=True,user_id='e80349d08b3648929ab76d731bd7b3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b38dd88-c6d1-4c76-b52c-d553dab727a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b38dd88-c6d1-4c76-b52c-d553dab727a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e857b7-21da-4dae-b663-4a3398c86a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e857b7-21da-4dae-b663-4a3398c86a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e38430c-4dd9-4d36-80ae-cb29d52a32fa', 'volume_name': 'volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afee970-6bab-46fd-849e-b5e080874c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afee970-6bab-46fd-849e-b5e080874c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75cbece-cc71-47a0-987c-9c430bb5eea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:04 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Volume 3e38430c-4dd9-4d36-80ae-cb29d52a32fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa', 'volume_size': 1} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-806652847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e38430c-4dd9-4d36-80ae-cb29d52a32fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8020ceb2d2754ba88419da8677e829b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:05Z,use_quota=True,user_id='e80349d08b3648929ab76d731bd7b3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Creating volume 3e38430c-4dd9-4d36-80ae-cb29d52a32fa {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:04 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:04 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa 1073741824 Nov 03 17:02:04 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b281d0a8-a0b7-4a7b-9dc1-c1681ca424fb req-60503a3e-3742-4520-a957-de6cd853f9b9 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:05 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa 1073741824" returned: 0 in 0.621s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:05 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa Nov 03 17:02:05 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:05 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa" returned: 0 in 0.306s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b281d0a8-a0b7-4a7b-9dc1-c1681ca424fb req-60503a3e-3742-4520-a957-de6cd853f9b9 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.546s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75cbece-cc71-47a0-987c-9c430bb5eea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b152157e-ed92-439d-acf1-561e883fe2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-b281d0a8-a0b7-4a7b-9dc1-c1681ca424fb req-60503a3e-3742-4520-a957-de6cd853f9b9 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Volume volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa (3e38430c-4dd9-4d36-80ae-cb29d52a32fa): created successfully Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b152157e-ed92-439d-acf1-561e883fe2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Flow 'volume_create_manager' (73fcb010-f072-45e7-a4a3-7685ddb5ea00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6ecd2a60-1163-442e-a0de-a3a300668ed7 tempest-VolumesTransfersV355Test-2095176879 None] Created volume successfully. Nov 03 17:02:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b281d0a8-a0b7-4a7b-9dc1-c1681ca424fb req-60503a3e-3742-4520-a957-de6cd853f9b9 tempest-AttachVolumeNegativeTest-454184678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5baddb75-6702-48b1-ab5b-ba34249c8b6b', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:02:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-b281d0a8-a0b7-4a7b-9dc1-c1681ca424fb req-60503a3e-3742-4520-a957-de6cd853f9b9 tempest-AttachVolumeNegativeTest-454184678 None] attachment_update completed successfully. Nov 03 17:02:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Acquiring lock "cinder-3e38430c-4dd9-4d36-80ae-cb29d52a32fa-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Lock "cinder-3e38430c-4dd9-4d36-80ae-cb29d52a32fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Acquiring lock "cinder-quobyte-3e38430c-4dd9-4d36-80ae-cb29d52a32fa" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Lock "cinder-quobyte-3e38430c-4dd9-4d36-80ae-cb29d52a32fa" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:07 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8abdec5-ecc1-4d46-af8e-1db358315044]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:07 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa Nov 03 17:02:07 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:08 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa" returned: 0 in 0.715s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:08 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa Nov 03 17:02:08 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:08 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e38430c-4dd9-4d36-80ae-cb29d52a32fa" returned: 0 in 0.461s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-29328334-5757-4db3-9597-4ac948be029f req-9df8ef4c-5005-4826-874a-39aa26a25e1f tempest-AttachVolumeNegativeTest-454184678 None] Terminate volume connection completed successfully. Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-29328334-5757-4db3-9597-4ac948be029f req-9df8ef4c-5005-4826-874a-39aa26a25e1f tempest-AttachVolumeNegativeTest-454184678 None] Deleting attachment 5baddb75-6702-48b1-ab5b-ba34249c8b6b. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Lock "cinder-quobyte-3e38430c-4dd9-4d36-80ae-cb29d52a32fa" released by "delete_volume" :: held 1.273s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Created reservations ['8ead160a-db76-4feb-8c8d-e7dbe0a18791', 'e286d7d5-7e5e-4fa1-b8cf-c10313a04c1c', 'b993cdbb-a1fa-4da7-aeaf-c4ac29f8ffa0', '4689b4d4-52bc-480f-8ccf-6fc59f95478d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:09 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:09 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:09 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.352s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:09 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:09 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Deleted volume successfully. Nov 03 17:02:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3615a478-6529-41b2-ba4e-41a28c603ad5 tempest-VolumesTransfersV355Test-1210595358 None] Lock "cinder-3e38430c-4dd9-4d36-80ae-cb29d52a32fa-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-394c9348-5889-4b80-9f03-5651f3bedfed tempest-GroupSnapshotsV319Test-2095644401 None] Group tempest-GroupSnapshotsV319Test-Group-1223568830: creating Nov 03 17:02:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-394c9348-5889-4b80-9f03-5651f3bedfed tempest-GroupSnapshotsV319Test-2095644401 None] Group tempest-GroupSnapshotsV319Test-Group-1223568830: created successfully Nov 03 17:02:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-394c9348-5889-4b80-9f03-5651f3bedfed tempest-GroupSnapshotsV319Test-2095644401 None] Create group completed successfully. Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Flow 'volume_create_manager' (5027432c-07fc-4df5-84a4-2a5dbc69baeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585542fc-f5f6-494b-8d7d-5a33cce34041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585542fc-f5f6-494b-8d7d-5a33cce34041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-61674869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1b28cdc-e0c7-4703-8950-adbfa15f7637,host='devstack@QuobyteHD#QuobyteHD',id=24917044-9b39-4d99-9ccf-ea40bb1c0b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be6463c61c54f0798e3ff78ffbdec07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:13Z,use_quota=True,user_id='305e01f56bd54a5eaa01f36d65d395b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b1e5531-5700-489b-897b-3a06e79ed5e2),volume_type_id=1b1e5531-5700-489b-897b-3a06e79ed5e2)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3368def8-ac2c-43f9-9e1c-a62ddd4fb5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3368def8-ac2c-43f9-9e1c-a62ddd4fb5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c49c7b1-dcbd-49c0-9448-417779e42adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c49c7b1-dcbd-49c0-9448-417779e42adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24917044-9b39-4d99-9ccf-ea40bb1c0b79', 'volume_name': 'volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca398a9-0b2a-42ab-a9b7-a0877026fc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca398a9-0b2a-42ab-a9b7-a0877026fc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345ccb42-6d01-4055-9d91-e18d122951c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:13 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Volume 24917044-9b39-4d99-9ccf-ea40bb1c0b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79', 'volume_size': 1} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1b28cdc-e0c7-4703-8950-adbfa15f7637,created_at=2026-11-03T16:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-61674869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1b28cdc-e0c7-4703-8950-adbfa15f7637,host='devstack@QuobyteHD#QuobyteHD',id=24917044-9b39-4d99-9ccf-ea40bb1c0b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be6463c61c54f0798e3ff78ffbdec07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:13Z,use_quota=True,user_id='305e01f56bd54a5eaa01f36d65d395b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b1e5531-5700-489b-897b-3a06e79ed5e2),volume_type_id=1b1e5531-5700-489b-897b-3a06e79ed5e2)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Creating volume 24917044-9b39-4d99-9ccf-ea40bb1c0b79 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:13 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:13 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 1073741824 Nov 03 17:02:13 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:14 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 1073741824" returned: 0 in 0.992s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:14 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 Nov 03 17:02:14 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:14 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79" returned: 0 in 0.561s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345ccb42-6d01-4055-9d91-e18d122951c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2540a4-1933-4626-89cd-9fd93a257727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:15 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Volume volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 (24917044-9b39-4d99-9ccf-ea40bb1c0b79): created successfully Nov 03 17:02:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2540a4-1933-4626-89cd-9fd93a257727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Flow 'volume_create_manager' (5027432c-07fc-4df5-84a4-2a5dbc69baeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:15 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0a9b11da-2c41-419e-a599-68b286d1d324 tempest-GroupSnapshotsV319Test-2095644401 None] Created volume successfully. Nov 03 17:02:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] GroupSnapshot ceb069f3-33d2-4ea0-8b31-383b12035937: creating. Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Group snapshot ceb069f3-33d2-4ea0-8b31-383b12035937: creating. {{(pid=86939) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "cinder-3e562f70-fecd-459f-9b0d-3c96da9cd35a-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-3e562f70-fecd-459f-9b0d-3c96da9cd35a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Creating offline snapshot a04bdc52-1d19-401a-a370-33cdefa54d8f of volume 24917044-9b39-4d99-9ccf-ea40bb1c0b79 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c162c7-6da0-4da7-9204-c3554a95deb9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "cinder-quobyte-3e562f70-fecd-459f-9b0d-3c96da9cd35a" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-quobyte-3e562f70-fecd-459f-9b0d-3c96da9cd35a" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1196e32-5fb2-4ec1-92de-ebed994390b9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:16 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 Nov 03 17:02:16 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:17 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a Nov 03 17:02:17 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:17 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79" returned: 0 in 0.729s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:17 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a" returned: 0 in 0.646s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:17 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f 1G Nov 03 17:02:17 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:17 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a Nov 03 17:02:17 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:17 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3e562f70-fecd-459f-9b0d-3c96da9cd35a" returned: 0 in 0.377s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-quobyte-3e562f70-fecd-459f-9b0d-3c96da9cd35a" released by "delete_volume" :: held 1.109s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:17 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Created reservations ['6c0fedab-ccab-46bd-b3f5-2a2d623fe79f', 'd7415dec-cec5-4ef9-bfb7-ed469748c8f2', '347d176a-5a50-41dd-812e-b6730ed1f784', '296ac85d-d848-490f-a70a-91504b54ddde'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:18 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:18 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:18 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f 1G" returned: 0 in 0.854s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:18 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f Nov 03 17:02:18 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:18 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.378s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Deleted volume successfully. Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a62a773e-2747-40ea-a3b7-2b528341ac0d tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-3e562f70-fecd-459f-9b0d-3c96da9cd35a-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:18 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f" returned: 0 in 0.603s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:18 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:02:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:18 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f Nov 03 17:02:18 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:19 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f" returned: 0 in 0.381s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "cinder-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:19 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.info Nov 03 17:02:19 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "cinder-quobyte-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-quobyte-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ffb249-b227-4f7c-8b92-37e7dd3d002d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:19 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab Nov 03 17:02:19 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:19 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.info" returned: 0 in 0.663s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:19 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:02:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:20 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.info Nov 03 17:02:20 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:20 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab" returned: 0 in 0.711s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:20 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab Nov 03 17:02:20 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:20 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.info" returned: 0 in 0.451s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.890s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f85a4a0a-654e-4b45-90ed-e7f3590d89c2 tempest-GroupSnapshotsV319Test-2095644401 None] group_snapshot ceb069f3-33d2-4ea0-8b31-383b12035937: created successfully Nov 03 17:02:20 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab" returned: 0 in 0.562s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-quobyte-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab" released by "delete_volume" :: held 1.387s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:20 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Created reservations ['954254c7-fe7c-42e8-8e46-f2c46b84284a', 'b0d8095a-9f31-4408-b04c-e7ba64a28382', '5987706b-c811-4ddd-b325-65816bbca55a', '3f693588-3935-480b-88cd-db32fb07c23f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:21 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:21 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:21 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.411s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Deleted volume successfully. Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3827714d-8b62-42c0-8f04-eeb994751291 tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-639f7bb2-41b8-40f1-87ce-47ca68cfe7ab-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Flow 'volume_create_manager' (a923cb7e-3642-436e-a3d8-bdce32f47449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f2c864-a7be-4f7b-8195-ff6b2e5bb5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f2c864-a7be-4f7b-8195-ff6b2e5bb5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-433761495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f0182cd6214577b55b0e6d93a9becc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:22Z,use_quota=True,user_id='48c816605dc7460a9efdd7e2c1700ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a76e95-6dd9-458d-80f0-a3230bfcc5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a76e95-6dd9-458d-80f0-a3230bfcc5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36be8002-8705-4bd5-a3e4-088e6a658827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36be8002-8705-4bd5-a3e4-088e6a658827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2', 'volume_name': 'volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2', 'volume_size': 2}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134b5576-b118-4e14-82f2-e8aa73db7088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134b5576-b118-4e14-82f2-e8aa73db7088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca01814-cdfc-4742-89e0-204ad93d868b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:21 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Volume af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2', 'volume_size': 2} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-433761495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f0182cd6214577b55b0e6d93a9becc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:22Z,use_quota=True,user_id='48c816605dc7460a9efdd7e2c1700ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Creating volume af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:21 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 2147483648 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] group_snapshot ceb069f3-33d2-4ea0-8b31-383b12035937: deleting Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] group_snapshot ceb069f3-33d2-4ea0-8b31-383b12035937: deleting {{(pid=86939) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:02:21 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 2147483648 Nov 03 17:02:21 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Acquiring lock "cinder-quobyte-24917044-9b39-4d99-9ccf-ea40bb1c0b79" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Lock "cinder-quobyte-24917044-9b39-4d99-9ccf-ea40bb1c0b79" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Acquiring lock "cinder-quobyte-a04bdc52-1d19-401a-a370-33cdefa54d8f" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Lock "cinder-quobyte-a04bdc52-1d19-401a-a370-33cdefa54d8f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Deleting offline snapshot a04bdc52-1d19-401a-a370-33cdefa54d8f of volume 24917044-9b39-4d99-9ccf-ea40bb1c0b79 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] snapshot_file for this snap is: volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a5d31f-075f-43f0-a981-ff9ce921d420]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "cinder-5f01b757-a04b-4726-80f3-7b766ba60314-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-5f01b757-a04b-4726-80f3-7b766ba60314-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:22 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f Nov 03 17:02:22 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "cinder-quobyte-5f01b757-a04b-4726-80f3-7b766ba60314" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-quobyte-5f01b757-a04b-4726-80f3-7b766ba60314" acquired by "delete_volume" :: waited 0.046s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4877eb11-1e9a-4270-a2b8-8381289943fb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:22 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 Nov 03 17:02:22 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:22 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f" returned: 0 in 0.463s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0456d726-b3e2-4153-819d-59db8159596f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:22 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 2147483648" returned: 0 in 0.770s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:22 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 Nov 03 17:02:22 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 Nov 03 17:02:22 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:22 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:22 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314" returned: 0 in 0.522s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:22 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314 Nov 03 17:02:22 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:23 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2" returned: 0 in 0.350s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca01814-cdfc-4742-89e0-204ad93d868b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2', 'volume_size': 2}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d672d6-7258-412c-adcb-68ca6e519a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:23 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Volume volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 (af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2): created successfully Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d672d6-7258-412c-adcb-68ca6e519a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Flow 'volume_create_manager' (a923cb7e-3642-436e-a3d8-bdce32f47449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0daa7556-c421-481b-87f4-5cd9227e89c4 tempest-VolumesCloneNegativeTest-125506298 None] Created volume successfully. Nov 03 17:02:23 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79" returned: 0 in 0.626s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:23 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5f01b757-a04b-4726-80f3-7b766ba60314" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:23 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f Nov 03 17:02:23 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-quobyte-5f01b757-a04b-4726-80f3-7b766ba60314" released by "delete_volume" :: held 0.937s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Created reservations ['394aa093-05b9-4233-8171-b48d4f64df24', 'e81b6209-0728-4e55-8e1b-2162af164f33', 'de4bc5fe-fcf1-46d3-94d6-122c7863d4a8', 'efa7f354-8a50-41fe-b280-30fa1844a411'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:23 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:23 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:23 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f" returned: 0 in 0.392s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:23 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f Nov 03 17:02:23 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:23 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.269s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Deleted volume successfully. Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-12000257-06e4-41a1-b127-d7afe62268c6 tempest-AttachVolumeNegativeTest-454184678 None] Lock "cinder-5f01b757-a04b-4726-80f3-7b766ba60314-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:23 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79.a04bdc52-1d19-401a-a370-33cdefa54d8f" returned: 0 in 0.302s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Lock "cinder-quobyte-a04bdc52-1d19-401a-a370-33cdefa54d8f" released by "_delete_snapshot" :: held 1.941s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Lock "cinder-quobyte-24917044-9b39-4d99-9ccf-ea40bb1c0b79" released by "delete_snapshot" :: held 1.973s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Acquiring lock "cinder-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:24 devstack cinder-volume[86939]: WARNING cinder.quota [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1686119989 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1686119989, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:02:24 devstack cinder-volume[86939]: WARNING cinder.quota [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1686119989 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1686119989, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Lock "cinder-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] Created reservations ['d517c9a2-ac16-44ba-adf6-c61265e9b4d7', 'e1ec4f3d-46b3-4094-b0f5-0de8c50cabf4', 'e4312670-b1af-4197-b3cb-2ec76f5f190d', '18e65a7f-a86b-4857-b65e-8025bd078b95'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Acquiring lock "cinder-quobyte-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Lock "cinder-quobyte-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[77201358-7665-4808-8cfb-22d9e06ff788]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-81976d22-0c89-4fcd-8653-198d49cf912f tempest-GroupSnapshotsV319Test-2095644401 None] group_snapshot ceb069f3-33d2-4ea0-8b31-383b12035937: deleted successfully Nov 03 17:02:24 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 Nov 03 17:02:24 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:24 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2" returned: 0 in 0.399s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:24 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2 Nov 03 17:02:24 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:24 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Lock "cinder-quobyte-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2" released by "delete_volume" :: held 0.772s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:24 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Created reservations ['b19ebbed-3fc9-4092-8b91-1ba7abc71829', 'f46a6c7b-cf62-42cb-a98a-d679c999e1d1', 'fe477ea3-04da-48c3-9cc2-a85cf0901598', '01cfce31-37cd-41d3-82d5-ed9114dc3035'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:25 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:25 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:25 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.357s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Deleted volume successfully. Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-774dd067-c3b5-4265-8197-c2104edc69b3 tempest-VolumesCloneNegativeTest-125506298 None] Lock "cinder-af1295f7-7f8b-4c27-82ba-7f7e9e1f28e2-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Acquiring lock "cinder-quobyte-24917044-9b39-4d99-9ccf-ea40bb1c0b79" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "cinder-quobyte-24917044-9b39-4d99-9ccf-ea40bb1c0b79" acquired by "delete_volume" :: waited 0.038s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e634dcb8-25b3-40a7-acc4-82bce9714d48]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:26 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 Nov 03 17:02:26 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:26 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79" returned: 0 in 0.550s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:26 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79 Nov 03 17:02:26 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:26 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24917044-9b39-4d99-9ccf-ea40bb1c0b79" returned: 0 in 0.378s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "cinder-quobyte-24917044-9b39-4d99-9ccf-ea40bb1c0b79" released by "delete_volume" :: held 1.044s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:26 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Created reservations ['107a5825-8445-4d47-bd05-6174bdeb7c2f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:26 devstack cinder-volume[86939]: WARNING cinder.quota [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1686119989 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1686119989, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:02:26 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Created reservations ['d99413a9-0f7b-4a34-9d2c-f175b9295f36', 'd2001832-4103-4fab-bba0-4a46e475153f', 'f11530d7-0561-4dd3-8476-40da613608b6', 'd9f9dba0-3032-4fff-9feb-8f9d3c74be66'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:27 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:27 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:27 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.286s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:27 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1a764818-47a0-4194-a569-9a8816661183 tempest-GroupSnapshotsV319Test-2095644401 None] Delete group completed successfully. Nov 03 17:02:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:02:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:30 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:30 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:31 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.324s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:02:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:02:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Flow 'volume_create_manager' (2f331e3f-c8c3-4c9c-9152-500f92245777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af581b30-a99d-4cda-b123-913791fc9240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af581b30-a99d-4cda-b123-913791fc9240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1521078881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f46121-8c76-4f31-894c-dbe0b307e00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a5132f47e146f987ea75a1b6277788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:35Z,use_quota=True,user_id='6f4bb400748c4accb4db80fbf3c0f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a711b9-8de9-483f-8dec-28f61e712a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a711b9-8de9-483f-8dec-28f61e712a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08990863-9825-410e-9bbf-a7b01bcae371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08990863-9825-410e-9bbf-a7b01bcae371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f46121-8c76-4f31-894c-dbe0b307e00f', 'volume_name': 'volume-51f46121-8c76-4f31-894c-dbe0b307e00f', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f26b739-6f68-42a7-a795-69e26f257e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f26b739-6f68-42a7-a795-69e26f257e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4793db-57df-4bef-983a-a0900eb8b3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:35 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Volume 51f46121-8c76-4f31-894c-dbe0b307e00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f46121-8c76-4f31-894c-dbe0b307e00f', 'volume_size': 1} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1521078881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f46121-8c76-4f31-894c-dbe0b307e00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a5132f47e146f987ea75a1b6277788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:35Z,use_quota=True,user_id='6f4bb400748c4accb4db80fbf3c0f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Creating volume 51f46121-8c76-4f31-894c-dbe0b307e00f {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:35 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:35 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f 1073741824 Nov 03 17:02:35 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:36 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f 1073741824" returned: 0 in 0.825s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:36 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f Nov 03 17:02:36 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:36 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f" returned: 0 in 0.485s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4793db-57df-4bef-983a-a0900eb8b3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f46121-8c76-4f31-894c-dbe0b307e00f', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb86d16b-aa08-4e92-9c90-9d491c291a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:37 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Volume volume-51f46121-8c76-4f31-894c-dbe0b307e00f (51f46121-8c76-4f31-894c-dbe0b307e00f): created successfully Nov 03 17:02:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb86d16b-aa08-4e92-9c90-9d491c291a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Flow 'volume_create_manager' (2f331e3f-c8c3-4c9c-9152-500f92245777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-6cc3e152-3150-48f8-b451-942998751c57 req-ccc5c7df-3f8d-4e1b-856d-6a5539bf1978 tempest-VolumesSnapshotsTestJSON-1419041696 None] Created volume successfully. Nov 03 17:02:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5d32a724-c4bd-4395-a52e-e75ed22a22a4 tempest-GroupsTest-528925471 None] Group tempest-Group1-1491645700: creating Nov 03 17:02:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5d32a724-c4bd-4395-a52e-e75ed22a22a4 tempest-GroupsTest-528925471 None] Group tempest-Group1-1491645700: created successfully Nov 03 17:02:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5d32a724-c4bd-4395-a52e-e75ed22a22a4 tempest-GroupsTest-528925471 None] Create group completed successfully. Nov 03 17:02:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Creating offline snapshot 13b04eb4-dd20-4303-a719-50de7f2b4718 of volume 51f46121-8c76-4f31-894c-dbe0b307e00f {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:02:38 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722cd27-38f9-4a2a-b709-9e1308df1270]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:38 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f Nov 03 17:02:38 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:38 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f" returned: 0 in 0.589s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-530ac402-0972-4084-b756-6ca1becb5cd4 tempest-GroupsTest-528925471 None] Group tempest-Group2-1682221033: creating Nov 03 17:02:38 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 1G Nov 03 17:02:38 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-530ac402-0972-4084-b756-6ca1becb5cd4 tempest-GroupsTest-528925471 None] Group tempest-Group2-1682221033: created successfully Nov 03 17:02:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-530ac402-0972-4084-b756-6ca1becb5cd4 tempest-GroupsTest-528925471 None] Create group completed successfully. Nov 03 17:02:39 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 1G" returned: 0 in 0.552s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f46121-8c76-4f31-894c-dbe0b307e00f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:39 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f46121-8c76-4f31-894c-dbe0b307e00f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 Nov 03 17:02:39 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:39 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f46121-8c76-4f31-894c-dbe0b307e00f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:39 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 is being set with open permissions: ugo+rw Nov 03 17:02:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:39 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 Nov 03 17:02:39 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:40 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718" returned: 0 in 0.367s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:40 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.info Nov 03 17:02:40 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:40 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.info" returned: 0 in 0.411s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:40 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.info is being set with open permissions: ugo+rw Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:40 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.info Nov 03 17:02:40 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Flow 'volume_create_manager' (39db5c6b-5f17-42d4-9418-2ce6e0758b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e664995-7feb-4962-aed7-81cbc67dc92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e664995-7feb-4962-aed7-81cbc67dc92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-171476205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1770170b-83f0-4289-bcce-880a657fdcd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d91eff2a9cf4da6b2d19d711ad42f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:41Z,use_quota=True,user_id='3c6c1bef83ba4e69ba3f2881e6d60845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038efbf1-b74e-496d-b318-aa5d82fd940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038efbf1-b74e-496d-b318-aa5d82fd940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdef7835-9faf-491d-95b5-a8f7e3c13e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdef7835-9faf-491d-95b5-a8f7e3c13e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1770170b-83f0-4289-bcce-880a657fdcd1', 'volume_name': 'volume-1770170b-83f0-4289-bcce-880a657fdcd1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b8ad23-4231-48e5-a782-9bfe959d4358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b8ad23-4231-48e5-a782-9bfe959d4358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b83fac-3bb8-46b6-ab21-2a308b94550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Volume 1770170b-83f0-4289-bcce-880a657fdcd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1770170b-83f0-4289-bcce-880a657fdcd1', 'volume_size': 1} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Flow 'volume_create_manager' (ef4dbc37-61ed-4030-9855-0621f7f88b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865621cd-2902-4736-a4a4-29bcd20df89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865621cd-2902-4736-a4a4-29bcd20df89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-887654975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c5f8669-d0b1-4048-84f8-8ca5b77b2db0,host='devstack@QuobyteHD#QuobyteHD',id=3b8f4cf7-ef84-4456-b928-b77318707253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d30761a3f3345b5b82a86faf45ddd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:41Z,use_quota=True,user_id='6e09f7c11ad640aa92b9aa2f437fca04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdf758e3-350c-44c8-a36a-f5ace8d41ff1),volume_type_id=fdf758e3-350c-44c8-a36a-f5ace8d41ff1)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41af318-697f-4e7c-8855-f96cb866e973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41af318-697f-4e7c-8855-f96cb866e973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffa5b66-7780-4f03-8391-6cffea7e4c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffa5b66-7780-4f03-8391-6cffea7e4c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8f4cf7-ef84-4456-b928-b77318707253', 'volume_name': 'volume-3b8f4cf7-ef84-4456-b928-b77318707253', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec767d85-1ffa-4316-a964-46492a1c593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec767d85-1ffa-4316-a964-46492a1c593d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c0c5cc-b76f-40ac-9937-ea4d2ac2a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:40 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Volume 3b8f4cf7-ef84-4456-b928-b77318707253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8f4cf7-ef84-4456-b928-b77318707253', 'volume_size': 1} Nov 03 17:02:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:41 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.info" returned: 0 in 0.493s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-171476205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1770170b-83f0-4289-bcce-880a657fdcd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d91eff2a9cf4da6b2d19d711ad42f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:41Z,use_quota=True,user_id='3c6c1bef83ba4e69ba3f2881e6d60845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Creating volume 1770170b-83f0-4289-bcce-880a657fdcd1 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:41 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:41 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 1073741824 Nov 03 17:02:41 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-d059e58f-d8ba-4015-986a-59fcf9bb1e4c req-6920268f-d06c-4d75-8098-90b6c166f2c1 tempest-VolumesSnapshotsTestJSON-1419041696 None] Create snapshot completed successfully Nov 03 17:02:41 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 1073741824" returned: 0 in 0.601s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:41 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 Nov 03 17:02:41 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:42 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1" returned: 0 in 0.276s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c5f8669-d0b1-4048-84f8-8ca5b77b2db0,created_at=2026-11-03T16:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-887654975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c5f8669-d0b1-4048-84f8-8ca5b77b2db0,host='devstack@QuobyteHD#QuobyteHD',id=3b8f4cf7-ef84-4456-b928-b77318707253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d30761a3f3345b5b82a86faf45ddd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:41Z,use_quota=True,user_id='6e09f7c11ad640aa92b9aa2f437fca04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdf758e3-350c-44c8-a36a-f5ace8d41ff1),volume_type_id=fdf758e3-350c-44c8-a36a-f5ace8d41ff1)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Creating volume 3b8f4cf7-ef84-4456-b928-b77318707253 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:42 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b83fac-3bb8-46b6-ab21-2a308b94550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1770170b-83f0-4289-bcce-880a657fdcd1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c959788d-9f2b-4986-beff-ffef977b9e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:42 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 1073741824 Nov 03 17:02:42 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:42 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Volume volume-1770170b-83f0-4289-bcce-880a657fdcd1 (1770170b-83f0-4289-bcce-880a657fdcd1): created successfully Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c959788d-9f2b-4986-beff-ffef977b9e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Flow 'volume_create_manager' (39db5c6b-5f17-42d4-9418-2ce6e0758b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "cinder-13b04eb4-dd20-4303-a719-50de7f2b4718-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8abe7698-0ba7-4d7f-8ac1-d4b33e8e20b4 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Created volume successfully. Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-13b04eb4-dd20-4303-a719-50de7f2b4718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "cinder-quobyte-51f46121-8c76-4f31-894c-dbe0b307e00f" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-quobyte-51f46121-8c76-4f31-894c-dbe0b307e00f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "cinder-quobyte-13b04eb4-dd20-4303-a719-50de7f2b4718" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-quobyte-13b04eb4-dd20-4303-a719-50de7f2b4718" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Deleting offline snapshot 13b04eb4-dd20-4303-a719-50de7f2b4718 of volume 51f46121-8c76-4f31-894c-dbe0b307e00f {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] snapshot_file for this snap is: volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0cf75e-2938-4415-854e-8fb32dbe8c0c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:42 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 Nov 03 17:02:42 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:42 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 1073741824" returned: 0 in 0.650s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:42 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 Nov 03 17:02:42 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:42 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718" returned: 0 in 0.509s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51f46121-8c76-4f31-894c-dbe0b307e00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47944ec-fe2d-4c68-8ade-def7c5c2629b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:43 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f Nov 03 17:02:43 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:43 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253" returned: 0 in 0.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c0c5cc-b76f-40ac-9937-ea4d2ac2a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8f4cf7-ef84-4456-b928-b77318707253', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a489ce11-d17a-4bcd-ac9b-5ae9a536e85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:43 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Volume volume-3b8f4cf7-ef84-4456-b928-b77318707253 (3b8f4cf7-ef84-4456-b928-b77318707253): created successfully Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a489ce11-d17a-4bcd-ac9b-5ae9a536e85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Flow 'volume_create_manager' (ef4dbc37-61ed-4030-9855-0621f7f88b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:43 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-10ba773f-e8f5-44cb-96b3-63cac7258714 tempest-GroupsTest-528925471 None] Created volume successfully. Nov 03 17:02:43 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f" returned: 0 in 0.587s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:43 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 Nov 03 17:02:43 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-d176226a-4cbb-4ed0-af28-15177f0e77e2 req-2e83638d-9638-439d-bcbb-b4f243895472 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-d176226a-4cbb-4ed0-af28-15177f0e77e2 req-2e83638d-9638-439d-bcbb-b4f243895472 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-d176226a-4cbb-4ed0-af28-15177f0e77e2 req-2e83638d-9638-439d-bcbb-b4f243895472 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-d176226a-4cbb-4ed0-af28-15177f0e77e2 req-2e83638d-9638-439d-bcbb-b4f243895472 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-1770170b-83f0-4289-bcce-880a657fdcd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3eafa9f-e0dc-4ccc-bb26-26c56b786ddf', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:02:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-d176226a-4cbb-4ed0-af28-15177f0e77e2 req-2e83638d-9638-439d-bcbb-b4f243895472 tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] attachment_update completed successfully. Nov 03 17:02:44 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718" returned: 0 in 0.536s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:44 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718 Nov 03 17:02:44 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:44 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f.13b04eb4-dd20-4303-a719-50de7f2b4718" returned: 0 in 0.310s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-quobyte-13b04eb4-dd20-4303-a719-50de7f2b4718" released by "_delete_snapshot" :: held 2.127s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-quobyte-51f46121-8c76-4f31-894c-dbe0b307e00f" released by "delete_snapshot" :: held 2.163s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:44 devstack cinder-volume[86939]: DEBUG cinder.quota [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Created reservations ['9c4fbfd5-9b7b-420e-80da-e13d5bd8d727', '66aeb913-c87a-4281-b059-ef3995e5333b', 'c67fe6c4-4f3d-466c-afec-f69ac7a763f8', 'ad1cc62f-fa8b-4405-bb6d-0e6a9dbf0cc8'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Delete snapshot completed successfully. Nov 03 17:02:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-25accd70-13f3-4038-9f21-a07c9dc0ded4 req-c5684f69-17db-4a11-895f-93cd35276d88 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-13b04eb4-dd20-4303-a719-50de7f2b4718-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Acquiring lock "cinder-quobyte-3b8f4cf7-ef84-4456-b928-b77318707253" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Lock "cinder-quobyte-3b8f4cf7-ef84-4456-b928-b77318707253" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "cinder-51f46121-8c76-4f31-894c-dbe0b307e00f-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-51f46121-8c76-4f31-894c-dbe0b307e00f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3316269-d612-4736-85f1-3c38b48fc559]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "cinder-quobyte-51f46121-8c76-4f31-894c-dbe0b307e00f" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-quobyte-51f46121-8c76-4f31-894c-dbe0b307e00f" acquired by "delete_volume" :: waited 0.035s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:45 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 Nov 03 17:02:45 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb8f477-6ef7-415a-b160-83d5852f3f23]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:46 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f Nov 03 17:02:46 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:46 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253" returned: 0 in 0.487s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:46 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253 Nov 03 17:02:46 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:46 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f" returned: 0 in 0.478s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:46 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f Nov 03 17:02:46 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:46 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b8f4cf7-ef84-4456-b928-b77318707253" returned: 0 in 0.319s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Lock "cinder-quobyte-3b8f4cf7-ef84-4456-b928-b77318707253" released by "delete_volume" :: held 0.959s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Created reservations ['2dfcaf4d-4ede-4db3-b597-dfb0fd570a77'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:46 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1531277565 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1531277565, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:02:46 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1531277565 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1531277565, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Created reservations ['38203da4-6ea0-4914-aa79-503938062a44', '0711aa04-e983-4ea3-bbf8-757c952cbe1e', '6ab6a9a2-94de-4101-8f64-bbf24dd5b772', '03957d70-e500-43d2-b813-2e4549c082ea'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:46 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-51f46121-8c76-4f31-894c-dbe0b307e00f" returned: 0 in 0.397s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-quobyte-51f46121-8c76-4f31-894c-dbe0b307e00f" released by "delete_volume" :: held 0.979s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:46 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.quota [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Created reservations ['23b2660b-26c2-4b75-8b52-c4b4ea9071ac', '370c7ffa-a9ff-4649-a7f4-7ac2fb2aaf68', 'a1895a43-a1f2-40cd-ba04-bcf07bdefff9', '4fe4d6d6-ca64-4ed1-ac68-2dfb1b5b2c50'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:46 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:47 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:47 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:47 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.550s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0ffabe84-42a4-4eb0-8258-ab65befa53b2 tempest-GroupsTest-528925471 None] Delete group completed successfully. Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Created reservations ['ab60a506-184c-4d2a-957b-66a30d0efbcc'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:47 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.454s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.manager [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Deleted volume successfully. Nov 03 17:02:47 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:47 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-65eb0517-e247-404f-9f72-c7ed9fc5983e req-bb882067-5fb7-40dc-8671-ca02d678b042 tempest-VolumesSnapshotsTestJSON-1419041696 None] Lock "cinder-51f46121-8c76-4f31-894c-dbe0b307e00f-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:48 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-d2ccb7d8-de3f-44cb-a9c2-555ed0d06d21 req-198cb074-6c1e-4499-a175-6f55725506be tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Terminate volume connection completed successfully. Nov 03 17:02:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-d2ccb7d8-de3f-44cb-a9c2-555ed0d06d21 req-198cb074-6c1e-4499-a175-6f55725506be tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Deleting attachment c3eafa9f-e0dc-4ccc-bb26-26c56b786ddf. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:02:48 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.382s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:48 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:48 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-61f7b001-83ef-4755-9e68-65e9422f4d42 tempest-GroupsTest-528925471 None] Delete group completed successfully. Nov 03 17:02:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Acquiring lock "cinder-1770170b-83f0-4289-bcce-880a657fdcd1-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "cinder-1770170b-83f0-4289-bcce-880a657fdcd1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Acquiring lock "cinder-quobyte-1770170b-83f0-4289-bcce-880a657fdcd1" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:02:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "cinder-quobyte-1770170b-83f0-4289-bcce-880a657fdcd1" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:02:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6809a1fc-5011-4155-809f-4e9857a7711f tempest-GroupsTest-528925471 None] Group tempest-GroupsTest-Group-746029811: creating Nov 03 17:02:49 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d51297-f709-4a62-8fd5-4f3a9fecd0c9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:02:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6809a1fc-5011-4155-809f-4e9857a7711f tempest-GroupsTest-528925471 None] Group tempest-GroupsTest-Group-746029811: created successfully Nov 03 17:02:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6809a1fc-5011-4155-809f-4e9857a7711f tempest-GroupsTest-528925471 None] Create group completed successfully. Nov 03 17:02:49 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 Nov 03 17:02:49 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:49 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1" returned: 0 in 0.460s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:49 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1 Nov 03 17:02:49 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:50 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1770170b-83f0-4289-bcce-880a657fdcd1" returned: 0 in 0.282s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "cinder-quobyte-1770170b-83f0-4289-bcce-880a657fdcd1" released by "delete_volume" :: held 0.811s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Created reservations ['16bf1aaa-a2b2-4f34-8a80-1c2b65baa320', 'cae3bdee-cf62-4b88-b092-fde9a42c34bf', 'e8fbf10c-249c-40d4-b94c-b2ccbcb55ccb', '492e7f0c-44d5-4276-aca8-c4cc49808740'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:50 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:02:50 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:50 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.477s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:50 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Deleted volume successfully. Nov 03 17:02:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b2658-43fe-45dc-8f72-15ef27aedc8d tempest-TestServerVolumeAttachScenarioOldVersion-429355926 None] Lock "cinder-1770170b-83f0-4289-bcce-880a657fdcd1-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Flow 'volume_create_manager' (9c160d1c-e8e5-4f19-8bae-3a338c52cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757c8051-4115-4c72-8dc9-f456c2ec5f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757c8051-4115-4c72-8dc9-f456c2ec5f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966526477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fea2e05-58bd-4833-b8ac-8e8f5c14a6b0,host='devstack@QuobyteHD#QuobyteHD',id=464d5d29-7a8c-44cb-8f70-45478143ecf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d30761a3f3345b5b82a86faf45ddd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:52Z,use_quota=True,user_id='6e09f7c11ad640aa92b9aa2f437fca04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f8d0fd7-7f4b-4b02-b2ac-26ce17067212),volume_type_id=8f8d0fd7-7f4b-4b02-b2ac-26ce17067212)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25f5ec9-d248-4e42-866e-ed0337ee1bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25f5ec9-d248-4e42-866e-ed0337ee1bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0055f28-1c4c-464a-8b2c-8357edd0712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0055f28-1c4c-464a-8b2c-8357edd0712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464d5d29-7a8c-44cb-8f70-45478143ecf8', 'volume_name': 'volume-464d5d29-7a8c-44cb-8f70-45478143ecf8', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a4a541-bc2a-432e-92b4-34ab595d05e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a4a541-bc2a-432e-92b4-34ab595d05e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f9e43d-2d4a-42ff-9761-c7ac2228b9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:51 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Volume 464d5d29-7a8c-44cb-8f70-45478143ecf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464d5d29-7a8c-44cb-8f70-45478143ecf8', 'volume_size': 1} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3fea2e05-58bd-4833-b8ac-8e8f5c14a6b0,created_at=2026-11-03T16:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966526477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fea2e05-58bd-4833-b8ac-8e8f5c14a6b0,host='devstack@QuobyteHD#QuobyteHD',id=464d5d29-7a8c-44cb-8f70-45478143ecf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d30761a3f3345b5b82a86faf45ddd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:52Z,use_quota=True,user_id='6e09f7c11ad640aa92b9aa2f437fca04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f8d0fd7-7f4b-4b02-b2ac-26ce17067212),volume_type_id=8f8d0fd7-7f4b-4b02-b2ac-26ce17067212)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Creating volume 464d5d29-7a8c-44cb-8f70-45478143ecf8 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:51 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:51 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 1073741824 Nov 03 17:02:51 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:52 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 1073741824" returned: 0 in 0.698s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:52 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 Nov 03 17:02:52 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:53 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8" returned: 0 in 0.485s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:53 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=135,cinder:INSERT=42,cinder:UPDATE=146,cinder:DELETE=10 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:02:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f9e43d-2d4a-42ff-9761-c7ac2228b9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464d5d29-7a8c-44cb-8f70-45478143ecf8', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0793260-6ebf-4cad-a1ff-86ad31c94846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Volume volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 (464d5d29-7a8c-44cb-8f70-45478143ecf8): created successfully Nov 03 17:02:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0793260-6ebf-4cad-a1ff-86ad31c94846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Flow 'volume_create_manager' (9c160d1c-e8e5-4f19-8bae-3a338c52cd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:53 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-562e79f2-4d07-4735-98e8-af9b5e68bfea tempest-GroupsTest-528925471 None] Created volume successfully. Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=150,cinder:UPDATE=165,cinder:INSERT=30,cinder:DELETE=7 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Flow 'volume_create_manager' (98555835-4dbc-4274-bd2a-963c25cfa65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2d1fd0-5542-42ac-93d4-f84251327859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2d1fd0-5542-42ac-93d4-f84251327859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111637938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fea2e05-58bd-4833-b8ac-8e8f5c14a6b0,host='devstack@QuobyteHD#QuobyteHD',id=2c501f1b-f728-49ed-afff-87710c96f0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d30761a3f3345b5b82a86faf45ddd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:55Z,use_quota=True,user_id='6e09f7c11ad640aa92b9aa2f437fca04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f8d0fd7-7f4b-4b02-b2ac-26ce17067212),volume_type_id=8f8d0fd7-7f4b-4b02-b2ac-26ce17067212)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55f83f4-d7aa-45d3-b42d-d8dbf822a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55f83f4-d7aa-45d3-b42d-d8dbf822a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222248c2-c423-4e64-8e84-dc84c73e18a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222248c2-c423-4e64-8e84-dc84c73e18a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c501f1b-f728-49ed-afff-87710c96f0ee', 'volume_name': 'volume-2c501f1b-f728-49ed-afff-87710c96f0ee', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6197ca59-a0bf-47cd-ae88-c029905e4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6197ca59-a0bf-47cd-ae88-c029905e4a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599fcd7d-656b-488b-a62b-df38e2bc7947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:55 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Volume 2c501f1b-f728-49ed-afff-87710c96f0ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c501f1b-f728-49ed-afff-87710c96f0ee', 'volume_size': 1} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3fea2e05-58bd-4833-b8ac-8e8f5c14a6b0,created_at=2026-11-03T16:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111637938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fea2e05-58bd-4833-b8ac-8e8f5c14a6b0,host='devstack@QuobyteHD#QuobyteHD',id=2c501f1b-f728-49ed-afff-87710c96f0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d30761a3f3345b5b82a86faf45ddd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:55Z,use_quota=True,user_id='6e09f7c11ad640aa92b9aa2f437fca04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f8d0fd7-7f4b-4b02-b2ac-26ce17067212),volume_type_id=8f8d0fd7-7f4b-4b02-b2ac-26ce17067212)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Creating volume 2c501f1b-f728-49ed-afff-87710c96f0ee {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:55 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:55 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee 1073741824 Nov 03 17:02:55 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee 1073741824" returned: 0 in 0.638s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:55 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:55 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee Nov 03 17:02:55 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:56 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee" returned: 0 in 0.431s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599fcd7d-656b-488b-a62b-df38e2bc7947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c501f1b-f728-49ed-afff-87710c96f0ee', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bbe95c-f30c-490a-ad50-6587c4c89b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:56 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Volume volume-2c501f1b-f728-49ed-afff-87710c96f0ee (2c501f1b-f728-49ed-afff-87710c96f0ee): created successfully Nov 03 17:02:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bbe95c-f30c-490a-ad50-6587c4c89b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Flow 'volume_create_manager' (98555835-4dbc-4274-bd2a-963c25cfa65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:56 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ea31d40c-aebb-4c26-8780-e3bc74d3737a tempest-GroupsTest-528925471 None] Created volume successfully. Nov 03 17:02:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e6087e88-ce21-4754-8684-862f6c9a3f78 tempest-GroupsTest-528925471 None] Update group completed successfully. Nov 03 17:02:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3087250d-5815-4746-84af-eabda9a410fc tempest-GroupsTest-528925471 None] Update group completed successfully. Nov 03 17:03:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Acquiring lock "cinder-quobyte-2c501f1b-f728-49ed-afff-87710c96f0ee" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Lock "cinder-quobyte-2c501f1b-f728-49ed-afff-87710c96f0ee" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:01 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2bfd98-1013-4b63-bffe-fa7c8b70e051]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:01 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee Nov 03 17:03:01 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:01 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee" returned: 0 in 0.545s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:01 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee Nov 03 17:03:01 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:02 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2c501f1b-f728-49ed-afff-87710c96f0ee" returned: 0 in 0.345s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Lock "cinder-quobyte-2c501f1b-f728-49ed-afff-87710c96f0ee" released by "delete_volume" :: held 0.958s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Acquiring lock "cinder-quobyte-464d5d29-7a8c-44cb-8f70-45478143ecf8" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Lock "cinder-quobyte-464d5d29-7a8c-44cb-8f70-45478143ecf8" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[14acb182-1fb8-4b17-8668-244ef59bf401]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:02 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 Nov 03 17:03:02 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:02 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8" returned: 0 in 0.475s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:02 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8 Nov 03 17:03:02 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:03 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-464d5d29-7a8c-44cb-8f70-45478143ecf8" returned: 0 in 0.411s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Lock "cinder-quobyte-464d5d29-7a8c-44cb-8f70-45478143ecf8" released by "delete_volume" :: held 0.957s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Created reservations ['88f5ce77-c59f-432d-ab8e-b329a3c5cfac'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:03 devstack cinder-volume[86939]: WARNING cinder.quota [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1539274005 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1539274005, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:03:03 devstack cinder-volume[86939]: WARNING cinder.quota [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1539274005 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1539274005, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Created reservations ['03fe40bf-6a48-4c2e-98f6-8b7f9489714f', 'ed2650a5-978e-4019-84d5-a35644f7e993', '148a82c7-5313-4062-b089-a9e1aac66866', '0c28ac39-9c2a-400f-8740-152e3a9d6ed2'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Created reservations ['52800bf7-cd62-4bff-8dbf-ccbf95c200f5', '1fa6d0e2-d2c6-48d2-ab5e-33ab2b44569f', '039cf7c4-b978-4e80-87ea-b5f16e8d6362', '9ad77f5f-03c7-44af-b29d-054f68b24222'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:03 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:03:03 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:04 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.436s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:04 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-382f116b-4f4c-4375-a19f-f95d5d14535c tempest-GroupsTest-528925471 None] Delete group completed successfully. Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Flow 'volume_create_manager' (41fc194c-b7e7-4eb3-a91b-bb7cccf52a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91242eb6-be1d-46f2-9b18-1a27aa8d5147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91242eb6-be1d-46f2-9b18-1a27aa8d5147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2080331347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f9301e-0c36-45ec-a37d-ff96a76fa92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422cb964bd4c4ab0b7da4298e652616a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:04Z,use_quota=True,user_id='5b056c3efa3642db98a9434c983f06c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2740e708-4f3e-46c3-8216-e653201db283),volume_type_id=2740e708-4f3e-46c3-8216-e653201db283)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f647cda3-ae79-40eb-9b4a-c6e9de1807d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f647cda3-ae79-40eb-9b4a-c6e9de1807d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef0e37d-4854-4816-bd69-3a3913656d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef0e37d-4854-4816-bd69-3a3913656d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f9301e-0c36-45ec-a37d-ff96a76fa92e', 'volume_name': 'volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e6f36a-326a-403d-a35f-1d901942de36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e6f36a-326a-403d-a35f-1d901942de36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b805a0bb-c3aa-48fd-891a-0ed6e6f33693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:04 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume e7f9301e-0c36-45ec-a37d-ff96a76fa92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e', 'volume_size': 1} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2080331347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f9301e-0c36-45ec-a37d-ff96a76fa92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422cb964bd4c4ab0b7da4298e652616a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:04Z,use_quota=True,user_id='5b056c3efa3642db98a9434c983f06c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2740e708-4f3e-46c3-8216-e653201db283),volume_type_id=2740e708-4f3e-46c3-8216-e653201db283)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Creating volume e7f9301e-0c36-45ec-a37d-ff96a76fa92e {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:04 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:04 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e 1073741824 Nov 03 17:03:04 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Flow 'volume_create_manager' (2047d0a7-92a8-4e67-8c9e-71805033ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8634f571-52ce-42f3-9fd2-7250e88febd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8634f571-52ce-42f3-9fd2-7250e88febd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1730451537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad24b9b-7fd8-4821-8208-3b128aa92105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422cb964bd4c4ab0b7da4298e652616a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:05Z,use_quota=True,user_id='5b056c3efa3642db98a9434c983f06c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7be3d4d2-fe82-48c3-bd7c-96bb5c881ae4),volume_type_id=7be3d4d2-fe82-48c3-bd7c-96bb5c881ae4)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ecf680-c043-42e3-a52c-db81d261e236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ecf680-c043-42e3-a52c-db81d261e236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45024f4d-52ce-4b30-ae74-9f62f76202e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45024f4d-52ce-4b30-ae74-9f62f76202e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad24b9b-7fd8-4821-8208-3b128aa92105', 'volume_name': 'volume-4ad24b9b-7fd8-4821-8208-3b128aa92105', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58861665-ecb7-4027-a258-91294ea4c931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58861665-ecb7-4027-a258-91294ea4c931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd801562-6998-4aaa-b470-c197ab4a3428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume 4ad24b9b-7fd8-4821-8208-3b128aa92105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad24b9b-7fd8-4821-8208-3b128aa92105', 'volume_size': 1} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:05 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e 1073741824" returned: 0 in 0.853s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2889e014-1184-4889-9cda-6006909bdb68 tempest-GroupsV314Test-1975396642 None] Group tempest-GroupsV314Test-Group-1192060974: creating Nov 03 17:03:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2889e014-1184-4889-9cda-6006909bdb68 tempest-GroupsV314Test-1975396642 None] Group tempest-GroupsV314Test-Group-1192060974: created successfully Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2889e014-1184-4889-9cda-6006909bdb68 tempest-GroupsV314Test-1975396642 None] Create group completed successfully. Nov 03 17:03:05 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e Nov 03 17:03:05 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:05 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e" returned: 0 in 0.373s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1730451537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad24b9b-7fd8-4821-8208-3b128aa92105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422cb964bd4c4ab0b7da4298e652616a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:05Z,use_quota=True,user_id='5b056c3efa3642db98a9434c983f06c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7be3d4d2-fe82-48c3-bd7c-96bb5c881ae4),volume_type_id=7be3d4d2-fe82-48c3-bd7c-96bb5c881ae4)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Creating volume 4ad24b9b-7fd8-4821-8208-3b128aa92105 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:05 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b805a0bb-c3aa-48fd-891a-0ed6e6f33693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:05 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 1073741824 Nov 03 17:03:05 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd758c9-c731-4412-8b74-ee2b47b23a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e (e7f9301e-0c36-45ec-a37d-ff96a76fa92e): created successfully Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd758c9-c731-4412-8b74-ee2b47b23a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Flow 'volume_create_manager' (41fc194c-b7e7-4eb3-a91b-bb7cccf52a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-79a37476-ffb2-46e3-95c8-beb59bd0b232 tempest-TestInstancesWithCinderVolumes-1862722151 None] Created volume successfully. Nov 03 17:03:06 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 1073741824" returned: 0 in 0.712s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:06 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 Nov 03 17:03:06 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Flow 'volume_create_manager' (06c87514-a7e7-4a82-9f4f-bcc4b0b3b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c50cafa-a194-479c-bd10-81b3ef05aadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c50cafa-a194-479c-bd10-81b3ef05aadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1851257023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f5ed96-276c-4c26-a7de-8139005907ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422cb964bd4c4ab0b7da4298e652616a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:07Z,use_quota=True,user_id='5b056c3efa3642db98a9434c983f06c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bbdf2c-2b55-44dd-a8a0-396f6be4eb7a),volume_type_id=29bbdf2c-2b55-44dd-a8a0-396f6be4eb7a)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c4cf7c-8076-4b9b-9ff3-94a864797140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c4cf7c-8076-4b9b-9ff3-94a864797140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5b7a0f-4dc9-4eae-882b-76afff1b1cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:03:06 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105" returned: 0 in 0.432s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd801562-6998-4aaa-b470-c197ab4a3428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad24b9b-7fd8-4821-8208-3b128aa92105', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ed8502-f77f-4c41-b8a0-46ecdd0e3ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:06 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 (4ad24b9b-7fd8-4821-8208-3b128aa92105): created successfully Nov 03 17:03:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ed8502-f77f-4c41-b8a0-46ecdd0e3ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Flow 'volume_create_manager' (2047d0a7-92a8-4e67-8c9e-71805033ad11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cc109dc6-0937-412e-8327-3695adde1974 tempest-TestInstancesWithCinderVolumes-1862722151 None] Created volume successfully. Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Flow 'volume_create_manager' (81e8dbcb-512a-46fc-bc70-383364c855f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f90d41-e964-4db4-9d20-0c3b4c5659a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f90d41-e964-4db4-9d20-0c3b4c5659a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1641379362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7f68caf-fd55-4bcd-b3b8-1d05bd4ce495,host='devstack@QuobyteHD#QuobyteHD',id=c5044746-f049-4477-b23d-c35879476ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab16e81148a846f5905f4946767c5033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:07Z,use_quota=True,user_id='36a5688c8c3549b9a341a32cc46fd0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(185cae30-1790-4cf5-9d5e-804ced67c7a2),volume_type_id=185cae30-1790-4cf5-9d5e-804ced67c7a2)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd26e58-cb43-4e50-aaf4-5c905a6d7c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd26e58-cb43-4e50-aaf4-5c905a6d7c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29ff12c-4aa4-4903-b641-3cc17f89a8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29ff12c-4aa4-4903-b641-3cc17f89a8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5044746-f049-4477-b23d-c35879476ab4', 'volume_name': 'volume-c5044746-f049-4477-b23d-c35879476ab4', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e6bb16-ed3d-47a8-90b2-0b3a22519fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e6bb16-ed3d-47a8-90b2-0b3a22519fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e888484-a553-41c8-b06a-65e88276addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Volume c5044746-f049-4477-b23d-c35879476ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5044746-f049-4477-b23d-c35879476ab4', 'volume_size': 1} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e7f68caf-fd55-4bcd-b3b8-1d05bd4ce495,created_at=2026-11-03T16:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1641379362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7f68caf-fd55-4bcd-b3b8-1d05bd4ce495,host='devstack@QuobyteHD#QuobyteHD',id=c5044746-f049-4477-b23d-c35879476ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab16e81148a846f5905f4946767c5033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:07Z,use_quota=True,user_id='36a5688c8c3549b9a341a32cc46fd0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(185cae30-1790-4cf5-9d5e-804ced67c7a2),volume_type_id=185cae30-1790-4cf5-9d5e-804ced67c7a2)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Creating volume c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:07 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:07 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 1073741824 Nov 03 17:03:07 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5b7a0f-4dc9-4eae-882b-76afff1b1cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38f5ed96-276c-4c26-a7de-8139005907ea', 'volume_name': 'volume-38f5ed96-276c-4c26-a7de-8139005907ea', 'volume_size': 1, 'image_id': 'fa40c9c0-0735-463c-92d1-dacad733174d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa40c9c0-0735-463c-92d1-dacad733174d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--100071111', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '422cb964bd4c4ab0b7da4298e652616a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa40c9c0-0735-463c-92d1-dacad733174d', 'created_at': datetime.datetime(2026, 11, 3, 16, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 3, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa40c9c0-0735-463c-92d1-dacad733174d/file', 'properties': {}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715d8473-a139-4a53-a131-bec070212b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715d8473-a139-4a53-a131-bec070212b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68896b2-d324-4d5d-b705-3f555264dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume 38f5ed96-276c-4c26-a7de-8139005907ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38f5ed96-276c-4c26-a7de-8139005907ea', 'volume_size': 1, 'image_id': 'fa40c9c0-0735-463c-92d1-dacad733174d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa40c9c0-0735-463c-92d1-dacad733174d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--100071111', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '422cb964bd4c4ab0b7da4298e652616a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa40c9c0-0735-463c-92d1-dacad733174d', 'created_at': datetime.datetime(2026, 11, 3, 16, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 3, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa40c9c0-0735-463c-92d1-dacad733174d/file', 'properties': {}}, 'image_service': } Nov 03 17:03:07 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Trying to clone 38f5ed96-276c-4c26-a7de-8139005907ea from image fa40c9c0-0735-463c-92d1-dacad733174d at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa40c9c0-0735-463c-92d1-dacad733174d', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:03:08 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 1073741824" returned: 0 in 0.634s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:08 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 Nov 03 17:03:08 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:08 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4" returned: 0 in 0.334s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e888484-a553-41c8-b06a-65e88276addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5044746-f049-4477-b23d-c35879476ab4', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522f2965-cf64-4f2e-8f3a-173a5aa375c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:08 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Volume volume-c5044746-f049-4477-b23d-c35879476ab4 (c5044746-f049-4477-b23d-c35879476ab4): created successfully Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522f2965-cf64-4f2e-8f3a-173a5aa375c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Flow 'volume_create_manager' (81e8dbcb-512a-46fc-bc70-383364c855f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-edfa7610-123d-4ee6-b08f-6d047bd709bb tempest-GroupsV314Test-1975396642 None] Created volume successfully. Nov 03 17:03:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:10 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Cloning volume c5044746-f049-4477-b23d-c35879476ab4 to volume e6afc87b-b95f-4034-8533-e55e9bd202c4 Nov 03 17:03:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Creating offline snapshot 0081f61d-95dc-43cf-9101-14da26e93d04 of volume c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:03:10 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[53849ed0-4b7b-4456-beac-27c845295eea]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:11 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 Nov 03 17:03:11 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:11 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4" returned: 0 in 0.616s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:11 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 1G Nov 03 17:03:11 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD, size 20.69 MB, duration 4.35 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:03:12 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Image download 20.69 MB at 4.76 MB/s Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6d4bf-2ca4-4105-9846-515be7c21ff2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:12 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 1G" returned: 0 in 0.576s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5044746-f049-4477-b23d-c35879476ab4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:12 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5044746-f049-4477-b23d-c35879476ab4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 Nov 03 17:03:12 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:12 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD Nov 03 17:03:12 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:12 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5044746-f049-4477-b23d-c35879476ab4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04" returned: 0 in 0.383s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:12 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:12 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Temporary image fa40c9c0-0735-463c-92d1-dacad733174d is fetched for user 5b056c3efa3642db98a9434c983f06c6. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:03:12 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 Nov 03 17:03:12 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa42ef5-ce7f-469c-b511-edc0c325bec9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:12 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04" returned: 0 in 0.273s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:12 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD Nov 03 17:03:12 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:12 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.info Nov 03 17:03:12 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:13 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.info" returned: 0 in 0.384s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:13 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:03:13 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:13 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.info Nov 03 17:03:13 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:13 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.info" returned: 0 in 0.332s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Acquiring lock "cinder-quobyte-e6afc87b-b95f-4034-8533-e55e9bd202c4" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Lock "cinder-quobyte-e6afc87b-b95f-4034-8533-e55e9bd202c4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] snapshot: 0081f61d-95dc-43cf-9101-14da26e93d04, volume: e6afc87b-b95f-4034-8533-e55e9bd202c4, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7f12f-7b03-4c75-ae1d-879d61d39059]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:13 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 Nov 03 17:03:13 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:14 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04" returned: 0 in 0.435s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5044746-f049-4477-b23d-c35879476ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece314a-195b-4b41-b670-1f42e5a95cf3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:14 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 Nov 03 17:03:14 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:14 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4" returned: 0 in 0.418s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:03:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:14 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 Nov 03 17:03:14 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Flow 'volume_create_manager' (598a0c2d-5821-48fb-a196-2f1b2d61c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a210ed8-aa9e-4006-a8ea-59814261f33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a210ed8-aa9e-4006-a8ea-59814261f33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2143844459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e47f838-0965-42eb-86d7-39d0e6e067ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5e44eb90be415aa446bcdee27e75ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:15Z,use_quota=True,user_id='2da471aefc2549bfbcc6f76803554c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137f9eb5-8cc6-4088-b769-b6dbca18e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137f9eb5-8cc6-4088-b769-b6dbca18e604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221a032d-89d9-4f8d-a8a1-1852b626144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221a032d-89d9-4f8d-a8a1-1852b626144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e47f838-0965-42eb-86d7-39d0e6e067ad', 'volume_name': 'volume-8e47f838-0965-42eb-86d7-39d0e6e067ad', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7ea139-f629-4c6d-8a32-dddd0692757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7ea139-f629-4c6d-8a32-dddd0692757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c9e72a-27e4-4401-be7f-80544a35b266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:15 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Volume 8e47f838-0965-42eb-86d7-39d0e6e067ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e47f838-0965-42eb-86d7-39d0e6e067ad', 'volume_size': 1} Nov 03 17:03:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:21 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4" returned: 0 in 7.451s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:21 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:03:21 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Converted 1024.00 MB image at 137.41 MB/s Nov 03 17:03:21 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:03:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:22 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 Nov 03 17:03:22 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:22 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4" returned: 0 in 0.276s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Lock "cinder-quobyte-e6afc87b-b95f-4034-8533-e55e9bd202c4" released by "_copy_volume_from_snapshot" :: held 8.664s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Acquiring lock "cinder-quobyte-0081f61d-95dc-43cf-9101-14da26e93d04" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Lock "cinder-quobyte-0081f61d-95dc-43cf-9101-14da26e93d04" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Deleting offline snapshot 0081f61d-95dc-43cf-9101-14da26e93d04 of volume c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] snapshot_file for this snap is: volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c285a65c-f965-49f9-97ab-98eee2305e58]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:22 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 Nov 03 17:03:22 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:22 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04" returned: 0 in 0.525s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5044746-f049-4477-b23d-c35879476ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2d69b4-3085-41f2-afed-dbd2b86bf08c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:23 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 Nov 03 17:03:23 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:23 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4" returned: 0 in 0.583s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:23 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 Nov 03 17:03:23 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:23 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04" returned: 0 in 0.415s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:23 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04 Nov 03 17:03:23 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:24 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4.0081f61d-95dc-43cf-9101-14da26e93d04" returned: 0 in 0.290s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Lock "cinder-quobyte-0081f61d-95dc-43cf-9101-14da26e93d04" released by "_delete_snapshot" :: held 1.947s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.437s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.034s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1851257023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f5ed96-276c-4c26-a7de-8139005907ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422cb964bd4c4ab0b7da4298e652616a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:07Z,use_quota=True,user_id='5b056c3efa3642db98a9434c983f06c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bbdf2c-2b55-44dd-a8a0-396f6be4eb7a),volume_type_id=29bbdf2c-2b55-44dd-a8a0-396f6be4eb7a)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Creating volume 38f5ed96-276c-4c26-a7de-8139005907ea {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:24 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:24 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea 1073741824 Nov 03 17:03:24 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-61274510-785b-4236-88fc-b86cc636a97f tempest-GroupsV314Test-1975396642 None] Create group from source-group-e7f68caf-fd55-4bcd-b3b8-1d05bd4ce495 completed successfully. Nov 03 17:03:24 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea 1073741824" returned: 0 in 0.641s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:24 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea Nov 03 17:03:25 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:25 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea" returned: 0 in 0.279s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.936s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2143844459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e47f838-0965-42eb-86d7-39d0e6e067ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5e44eb90be415aa446bcdee27e75ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:15Z,use_quota=True,user_id='2da471aefc2549bfbcc6f76803554c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Creating volume 8e47f838-0965-42eb-86d7-39d0e6e067ad {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:25 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:25 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad 1073741824 Nov 03 17:03:25 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Attempting download of fa40c9c0-0735-463c-92d1-dacad733174d ((None, [{'url': 'file:///opt/stack/data/glance/images/fa40c9c0-0735-463c-92d1-dacad733174d', 'metadata': {}}])) to volume 38f5ed96-276c-4c26-a7de-8139005907ea. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a1449f-4e2b-4e22-8964-e6d1d14377d6]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa40c9c0-0735-463c-92d1-dacad733174d_ddgca2j6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:25 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa40c9c0-0735-463c-92d1-dacad733174d_ddgca2j6 Nov 03 17:03:25 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:25 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa40c9c0-0735-463c-92d1-dacad733174d_ddgca2j6" returned: 0 in 0.457s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa40c9c0-0735-463c-92d1-dacad733174d_ddgca2j6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:25 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad 1073741824" returned: 0 in 0.675s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:26 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa40c9c0-0735-463c-92d1-dacad733174d_ddgca2j6 Nov 03 17:03:26 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:26 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad Nov 03 17:03:26 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:26 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad" returned: 0 in 0.318s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c9e72a-27e4-4401-be7f-80544a35b266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e47f838-0965-42eb-86d7-39d0e6e067ad', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:26 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee81e222-3816-4c2b-bc01-80d5b7b918d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa40c9c0-0735-463c-92d1-dacad733174d_ddgca2j6" returned: 1 in 0.531s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa40c9c0-0735-463c-92d1-dacad733174d_ddgca2j6' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fa4fb9-8ab8-4e48-8182-a88109072039]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:26 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Volume volume-8e47f838-0965-42eb-86d7-39d0e6e067ad (8e47f838-0965-42eb-86d7-39d0e6e067ad): created successfully Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee81e222-3816-4c2b-bc01-80d5b7b918d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Flow 'volume_create_manager' (598a0c2d-5821-48fb-a196-2f1b2d61c568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Acquiring lock "cinder-quobyte-e6afc87b-b95f-4034-8533-e55e9bd202c4" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-757f3944-b2d2-445c-b0cf-d168f151aef8 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Created volume successfully. Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Lock "cinder-quobyte-e6afc87b-b95f-4034-8533-e55e9bd202c4" acquired by "delete_volume" :: waited 0.035s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfb7c89-10bc-41f1-a8a7-5d78e9d409d7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:26 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD Nov 03 17:03:26 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:26 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 Nov 03 17:03:26 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:26 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] fa40c9c0-0735-463c-92d1-dacad733174d was qcow2, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:03:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:26 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea Nov 03 17:03:26 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:27 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4" returned: 0 in 0.501s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:27 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4 Nov 03 17:03:27 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Acquiring lock "cinder-8e47f838-0965-42eb-86d7-39d0e6e067ad-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "cinder-8e47f838-0965-42eb-86d7-39d0e6e067ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:27 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6afc87b-b95f-4034-8533-e55e9bd202c4" returned: 0 in 0.373s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Acquiring lock "cinder-quobyte-8e47f838-0965-42eb-86d7-39d0e6e067ad" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Lock "cinder-quobyte-e6afc87b-b95f-4034-8533-e55e9bd202c4" released by "delete_volume" :: held 0.961s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "cinder-quobyte-8e47f838-0965-42eb-86d7-39d0e6e067ad" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[73003d9b-a96d-4e28-abc1-b9316c814b6a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Created reservations ['8d8f7a35-5318-4729-9a59-f62a08d8a673'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:27 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-229867679 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-229867679, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:03:27 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-229867679 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-229867679, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Created reservations ['aad36a8a-afca-4a0d-a4e7-2a8b5d880635', '02bbeb83-7c6d-49a0-b0c4-0bb333157eb9', 'efc40192-798d-4a27-9595-dd05dba6afea', '8f1b5712-4815-46a1-bf9e-92c62009e632'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:27 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad Nov 03 17:03:27 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:27 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:03:27 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:28 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.338s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0b793d68-eea6-483e-b8f7-e54d473157cb tempest-GroupsV314Test-1975396642 None] Delete group completed successfully. Nov 03 17:03:28 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad" returned: 0 in 0.731s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:28 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad Nov 03 17:03:28 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:28 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-8e47f838-0965-42eb-86d7-39d0e6e067ad" returned: 0 in 0.330s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "cinder-quobyte-8e47f838-0965-42eb-86d7-39d0e6e067ad" released by "delete_volume" :: held 1.128s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Created reservations ['f26ee27f-1b1e-4878-8f63-6cbf3c3e9e90', 'f3db8916-d9b1-4a2e-bf9f-874198b456f7', 'c2012979-f965-4bc1-9055-be6e4d330788', 'aa31af90-baff-4d5a-bbe2-d7d7af047b12'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:28 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:03:28 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:29 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.315s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Deleted volume successfully. Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e821f461-0d6d-4eef-9f29-27328c2d3997 tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "cinder-8e47f838-0965-42eb-86d7-39d0e6e067ad-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Acquiring lock "cinder-quobyte-c5044746-f049-4477-b23d-c35879476ab4" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Lock "cinder-quobyte-c5044746-f049-4477-b23d-c35879476ab4" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a411bce-865e-4393-8d3f-42acdd1e12dc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:29 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 Nov 03 17:03:29 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:29 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea" returned: 0 in 2.786s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa40c9c0-0735-463c-92d1-dacad733174d_h71_m8njdevstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:03:29 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Converted 112.00 MB image at 40.19 MB/s Nov 03 17:03:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:29 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea 1G Nov 03 17:03:29 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:30 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4" returned: 0 in 0.559s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:30 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4 Nov 03 17:03:30 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:30 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea 1G" returned: 0 in 0.482s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Downloaded image fa40c9c0-0735-463c-92d1-dacad733174d ((None, [{'url': 'file:///opt/stack/data/glance/images/fa40c9c0-0735-463c-92d1-dacad733174d', 'metadata': {}}])) to volume 38f5ed96-276c-4c26-a7de-8139005907ea successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Temporary image fa40c9c0-0735-463c-92d1-dacad733174d for user 5b056c3efa3642db98a9434c983f06c6 is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Marking volume 38f5ed96-276c-4c26-a7de-8139005907ea as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Copying metadata from image fa40c9c0-0735-463c-92d1-dacad733174d to 38f5ed96-276c-4c26-a7de-8139005907ea. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Creating volume glance metadata for volume 38f5ed96-276c-4c26-a7de-8139005907ea backed by image fa40c9c0-0735-463c-92d1-dacad733174d with: {'image_id': 'fa40c9c0-0735-463c-92d1-dacad733174d', 'image_name': 'tempest-scenario-img--100071111', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68896b2-d324-4d5d-b705-3f555264dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f5ed96-276c-4c26-a7de-8139005907ea', 'volume_size': 1, 'image_id': 'fa40c9c0-0735-463c-92d1-dacad733174d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa40c9c0-0735-463c-92d1-dacad733174d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--100071111', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '422cb964bd4c4ab0b7da4298e652616a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa40c9c0-0735-463c-92d1-dacad733174d', 'created_at': datetime.datetime(2026, 11, 3, 16, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 3, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa40c9c0-0735-463c-92d1-dacad733174d/file', 'properties': {}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd1339b-5f67-47bb-87ff-7e1243fa081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:30 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Volume volume-38f5ed96-276c-4c26-a7de-8139005907ea (38f5ed96-276c-4c26-a7de-8139005907ea): created successfully Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd1339b-5f67-47bb-87ff-7e1243fa081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Flow 'volume_create_manager' (06c87514-a7e7-4a82-9f4f-bcc4b0b3b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:30 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4294ae63-6781-4811-91e9-a9252f45aca6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Created volume successfully. Nov 03 17:03:30 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5044746-f049-4477-b23d-c35879476ab4" returned: 0 in 0.354s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Lock "cinder-quobyte-c5044746-f049-4477-b23d-c35879476ab4" released by "delete_volume" :: held 0.995s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Flow 'volume_create_manager' (a1544987-d3d9-4abb-8b45-d4f5eadeaca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be906e28-1bf8-462c-8c2a-8d7d19366359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Created reservations ['e86d8eea-81f0-4a6c-8ddf-f5dc33c1f7ed'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be906e28-1bf8-462c-8c2a-8d7d19366359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1198037834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a7530e-0eb3-48d8-be89-97d42824180e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5e44eb90be415aa446bcdee27e75ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:30Z,use_quota=True,user_id='2da471aefc2549bfbcc6f76803554c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e52b76d-36fd-4723-ba68-89a37024a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e52b76d-36fd-4723-ba68-89a37024a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54626b5f-5d22-4ca2-a983-163a8bafdaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54626b5f-5d22-4ca2-a983-163a8bafdaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a7530e-0eb3-48d8-be89-97d42824180e', 'volume_name': 'volume-15a7530e-0eb3-48d8-be89-97d42824180e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec12e435-9a34-4193-b11b-5d69276f0432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec12e435-9a34-4193-b11b-5d69276f0432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515e6208-c2ed-4d89-b7d5-21f94acf1582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:30 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Volume 15a7530e-0eb3-48d8-be89-97d42824180e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a7530e-0eb3-48d8-be89-97d42824180e', 'volume_size': 1} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1198037834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a7530e-0eb3-48d8-be89-97d42824180e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5e44eb90be415aa446bcdee27e75ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:30Z,use_quota=True,user_id='2da471aefc2549bfbcc6f76803554c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Creating volume 15a7530e-0eb3-48d8-be89-97d42824180e {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:30 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:30 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e 1073741824 Nov 03 17:03:30 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Created reservations ['ad9c5cda-1b5a-450b-8b2d-94710e35e120', '831edd43-ca87-4952-af36-03775105ad9b', '1d25e1a6-be84-4937-923a-7d53a249423a', '6d061d84-3c6c-470a-bcf3-284a1634813e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:30 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:03:30 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:30 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:03:30 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:31 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.330s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-70c1483d-462e-4f94-856e-1e58128dd406 tempest-GroupsV314Test-1975396642 None] Delete group completed successfully. Nov 03 17:03:31 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e 1073741824" returned: 0 in 0.601s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:31 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.374s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:03:31 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e Nov 03 17:03:31 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:31 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e" returned: 0 in 0.320s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515e6208-c2ed-4d89-b7d5-21f94acf1582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a7530e-0eb3-48d8-be89-97d42824180e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b583f892-e363-4b46-8e8b-be40c4f6bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:31 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Volume volume-15a7530e-0eb3-48d8-be89-97d42824180e (15a7530e-0eb3-48d8-be89-97d42824180e): created successfully Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b583f892-e363-4b46-8e8b-be40c4f6bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Flow 'volume_create_manager' (a1544987-d3d9-4abb-8b45-d4f5eadeaca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-fcbc89d3-84e3-44d9-920c-d586492112aa tempest-VolumeQuotasAdminTestJSON-1186540481 None] Created volume successfully. Nov 03 17:03:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-79e1c6b4-cb6e-4d17-8af3-ea0d2d663be2 tempest-VolumeQuotasAdminTestJSON-967962491 None] Transfer volume completed successfully. Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Acquiring lock "cinder-15a7530e-0eb3-48d8-be89-97d42824180e-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Lock "cinder-15a7530e-0eb3-48d8-be89-97d42824180e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Acquiring lock "cinder-quobyte-15a7530e-0eb3-48d8-be89-97d42824180e" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Lock "cinder-quobyte-15a7530e-0eb3-48d8-be89-97d42824180e" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944f910-2a57-440d-8c9d-89782ecdcf4f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-c2ecd6e8-b351-4116-9898-28c257c107f1 req-04f25c28-2c3f-4acb-ac27-610e69861506 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-c2ecd6e8-b351-4116-9898-28c257c107f1 req-04f25c28-2c3f-4acb-ac27-610e69861506 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-c2ecd6e8-b351-4116-9898-28c257c107f1 req-04f25c28-2c3f-4acb-ac27-610e69861506 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-c2ecd6e8-b351-4116-9898-28c257c107f1 req-04f25c28-2c3f-4acb-ac27-610e69861506 tempest-TestInstancesWithCinderVolumes-1862722151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-38f5ed96-276c-4c26-a7de-8139005907ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b16ebd7e-0f6f-4dee-9c68-c06454f24806', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:03:34 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e Nov 03 17:03:34 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-c2ecd6e8-b351-4116-9898-28c257c107f1 req-04f25c28-2c3f-4acb-ac27-610e69861506 tempest-TestInstancesWithCinderVolumes-1862722151 None] attachment_update completed successfully. Nov 03 17:03:35 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e" returned: 0 in 0.671s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:35 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e Nov 03 17:03:35 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:35 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a7530e-0eb3-48d8-be89-97d42824180e" returned: 0 in 0.348s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Lock "cinder-quobyte-15a7530e-0eb3-48d8-be89-97d42824180e" released by "delete_volume" :: held 1.099s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Created reservations ['1dcd0cba-6686-4815-bcc5-da08a815048a', 'd294d367-b429-4995-85ae-9c0585376ca4', '42002028-0a1c-4612-8b9a-fe809f707d19', '5b85e364-89e2-4ff9-97b6-8ef7f8670f87'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:35 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:03:35 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:36 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.332s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:36 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Deleted volume successfully. Nov 03 17:03:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2a87b34a-cb97-4d0f-8e92-4d47d28eb4d9 tempest-VolumeQuotasAdminTestJSON-638719607 None] Lock "cinder-15a7530e-0eb3-48d8-be89-97d42824180e-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:43 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Flow 'volume_create_manager' (0adc0641-23b5-4464-b994-9fc381064dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e420be-8b88-45d8-a022-2c2318911938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e420be-8b88-45d8-a022-2c2318911938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1382545773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a6a666-bd26-4258-aa22-09b9201986fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc705d282f30417cb94ad7064dc9281a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:44Z,use_quota=True,user_id='911a08be2cc64ffea5300c97aae779f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a68866-a201-411f-8b30-a8b5ba9b3b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a68866-a201-411f-8b30-a8b5ba9b3b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2c7847-9c93-4603-b649-2aa8b049c9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2c7847-9c93-4603-b649-2aa8b049c9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a6a666-bd26-4258-aa22-09b9201986fc', 'volume_name': 'volume-17a6a666-bd26-4258-aa22-09b9201986fc', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eaaf854-a4fb-4dc5-9e16-3c2a71f2afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eaaf854-a4fb-4dc5-9e16-3c2a71f2afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee4e1f2-af4f-43f4-b4c3-c8ed560d08ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Volume 17a6a666-bd26-4258-aa22-09b9201986fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a6a666-bd26-4258-aa22-09b9201986fc', 'volume_size': 1} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1382545773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a6a666-bd26-4258-aa22-09b9201986fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc705d282f30417cb94ad7064dc9281a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:44Z,use_quota=True,user_id='911a08be2cc64ffea5300c97aae779f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Creating volume 17a6a666-bd26-4258-aa22-09b9201986fc {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:44 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:03:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:44 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc 1073741824 Nov 03 17:03:44 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:45 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc 1073741824" returned: 0 in 0.921s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:45 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc Nov 03 17:03:45 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:45 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc" returned: 0 in 0.512s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee4e1f2-af4f-43f4-b4c3-c8ed560d08ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a6a666-bd26-4258-aa22-09b9201986fc', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec48837-597b-4361-b30d-fda4e36da2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:45 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Volume volume-17a6a666-bd26-4258-aa22-09b9201986fc (17a6a666-bd26-4258-aa22-09b9201986fc): created successfully Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec48837-597b-4361-b30d-fda4e36da2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Flow 'volume_create_manager' (0adc0641-23b5-4464-b994-9fc381064dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e1b38f5b-c446-46c5-ae19-8f90bb11ebd8 tempest-TestImageHashVerification-1981639934 None] Created volume successfully. Nov 03 17:03:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:48 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb3f339-854e-4012-b250-7c1dc3ca6951]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:48 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc Nov 03 17:03:48 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:48 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc" returned: 0 in 0.824s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:48 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2ab528-5b8f-4f2b-b818-4283e8308650]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:49 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc Nov 03 17:03:49 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:49 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc" returned: 0 in 0.803s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc /opt/stack/data/cinder/conversion/17a6a666-bd26-4258-aa22-09b9201986fc.temp_image.5caa977b-1b90-498b-887e-635503e2dbf52v5323yk.img {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:49 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc /opt/stack/data/cinder/conversion/17a6a666-bd26-4258-aa22-09b9201986fc.temp_image.5caa977b-1b90-498b-887e-635503e2dbf52v5323yk.img Nov 03 17:03:49 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:55 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:DELETE=8,cinder:UPDATE=93,cinder:SELECT=79,cinder:INSERT=27 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:03:58 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=83,cinder:UPDATE=87,cinder:INSERT=19,cinder:DELETE=3 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Flow 'volume_create_manager' (e0684e3e-65c4-4b7c-9251-61dc8ae0fba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67743363-054e-40e8-97ee-9b50c02e3e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67743363-054e-40e8-97ee-9b50c02e3e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-367316738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8462168-4ca7-4b97-938f-261e8d9f5261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71dbf11206c14f8e8f45dcec4c1ec69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:59Z,use_quota=True,user_id='113deaac86ce47e68709672dfc8fa1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbf485f-d473-4d0a-963a-8eef965037fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbf485f-d473-4d0a-963a-8eef965037fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e48396-889d-456b-a598-7595b749bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e48396-889d-456b-a598-7595b749bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8462168-4ca7-4b97-938f-261e8d9f5261', 'volume_name': 'volume-b8462168-4ca7-4b97-938f-261e8d9f5261', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2263f24-5ba3-4e93-9b89-67076876410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2263f24-5ba3-4e93-9b89-67076876410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6cb8a3-d132-455a-babe-42e75cdf8db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Volume b8462168-4ca7-4b97-938f-261e8d9f5261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8462168-4ca7-4b97-938f-261e8d9f5261', 'volume_size': 1} Nov 03 17:03:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:02 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc /opt/stack/data/cinder/conversion/17a6a666-bd26-4258-aa22-09b9201986fc.temp_image.5caa977b-1b90-498b-887e-635503e2dbf52v5323yk.img" returned: 0 in 12.654s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e4ddfe-a530-4155-8af6-ced9ae9a67fc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:02 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc Nov 03 17:04:02 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:03 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc" returned: 0 in 0.708s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:03 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc, size 1024.00 MB, duration 12.66 sec, destination /opt/stack/data/cinder/conversion/17a6a666-bd26-4258-aa22-09b9201986fc.temp_image.5caa977b-1b90-498b-887e-635503e2dbf52v5323yk.img {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:04:03 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Converted 1024.00 MB image at 80.92 MB/s Nov 03 17:04:03 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] 5caa977b-1b90-498b-887e-635503e2dbf5 was raw, no need to convert to raw {{(pid=86939) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Flow 'volume_create_manager' (12d1ea47-ab09-4406-8619-3f4c2eee5d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813b8956-1207-4365-8dc5-51c2d6bfaff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813b8956-1207-4365-8dc5-51c2d6bfaff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-867623488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f24b08d-e6b6-4f52-b7af-5fcad156a87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad99dda2e19483c92a9035c562ae30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:12Z,use_quota=True,user_id='153c8fe76b4d4967a40b963c464b0ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9738d3-5b41-4d53-ab11-d23b727c7a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9738d3-5b41-4d53-ab11-d23b727c7a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eec2adb-50ed-4abc-94d0-ff5b02aee4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eec2adb-50ed-4abc-94d0-ff5b02aee4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f24b08d-e6b6-4f52-b7af-5fcad156a87d', 'volume_name': 'volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf2cfb1-963c-4be0-82c6-fbd9ba7c5aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf2cfb1-963c-4be0-82c6-fbd9ba7c5aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af90bb0-53bb-43c1-bca6-14ca0f981321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:11 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Volume 0f24b08d-e6b6-4f52-b7af-5fcad156a87d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d', 'volume_size': 1} Nov 03 17:04:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-fe8372be-3e71-4017-af16-1482eb61f79b req-e8a6c5e7-6aa1-47d1-a8dd-219c619388c6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.705s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Uploaded volume to glance image-id: 5caa977b-1b90-498b-887e-635503e2dbf5. {{(pid=86939) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.158s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-367316738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8462168-4ca7-4b97-938f-261e8d9f5261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71dbf11206c14f8e8f45dcec4c1ec69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:59Z,use_quota=True,user_id='113deaac86ce47e68709672dfc8fa1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Creating volume b8462168-4ca7-4b97-938f-261e8d9f5261 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:24 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:04:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:24 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 1073741824 Nov 03 17:04:24 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c157333c-40d3-4077-a21c-6bd741fa5a75 tempest-TestImageHashVerification-1981639934 None] Copy volume to image completed successfully. Nov 03 17:04:25 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 1073741824" returned: 0 in 0.480s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 Nov 03 17:04:25 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:25 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261" returned: 0 in 0.267s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.883s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-867623488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f24b08d-e6b6-4f52-b7af-5fcad156a87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad99dda2e19483c92a9035c562ae30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:12Z,use_quota=True,user_id='153c8fe76b4d4967a40b963c464b0ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Creating volume 0f24b08d-e6b6-4f52-b7af-5fcad156a87d {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:25 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d 1073741824 Nov 03 17:04:25 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6cb8a3-d132-455a-babe-42e75cdf8db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8462168-4ca7-4b97-938f-261e8d9f5261', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd5f751-b482-4449-9f48-820a31dcb97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:25 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Volume volume-b8462168-4ca7-4b97-938f-261e8d9f5261 (b8462168-4ca7-4b97-938f-261e8d9f5261): created successfully Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd5f751-b482-4449-9f48-820a31dcb97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Flow 'volume_create_manager' (e0684e3e-65c4-4b7c-9251-61dc8ae0fba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f32d997b-c909-4b82-a19a-3fd491af4ece tempest-VolumesServicesTestJSON-1203687185 None] Created volume successfully. Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Acquiring lock "cinder-17a6a666-bd26-4258-aa22-09b9201986fc-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Lock "cinder-17a6a666-bd26-4258-aa22-09b9201986fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Acquiring lock "cinder-quobyte-17a6a666-bd26-4258-aa22-09b9201986fc" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Lock "cinder-quobyte-17a6a666-bd26-4258-aa22-09b9201986fc" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b1a884-04d1-4960-9ac6-8ef060bba331]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc Nov 03 17:04:26 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d 1073741824" returned: 0 in 0.518s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d Nov 03 17:04:26 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc" returned: 0 in 0.433s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc Nov 03 17:04:26 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d" returned: 0 in 0.291s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-fe8372be-3e71-4017-af16-1482eb61f79b req-e8a6c5e7-6aa1-47d1-a8dd-219c619388c6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.238s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-fe8372be-3e71-4017-af16-1482eb61f79b req-e8a6c5e7-6aa1-47d1-a8dd-219c619388c6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af90bb0-53bb-43c1-bca6-14ca0f981321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab9d59e-8240-4ae7-8313-ce4458baf522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:26 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Volume volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d (0f24b08d-e6b6-4f52-b7af-5fcad156a87d): created successfully Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab9d59e-8240-4ae7-8313-ce4458baf522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Flow 'volume_create_manager' (12d1ea47-ab09-4406-8619-3f4c2eee5d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Acquiring lock "cinder-b8462168-4ca7-4b97-938f-261e8d9f5261-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f6d2f774-61ea-4f57-aebb-c141743de85a tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Created volume successfully. Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-fe8372be-3e71-4017-af16-1482eb61f79b req-e8a6c5e7-6aa1-47d1-a8dd-219c619388c6 tempest-TestInstancesWithCinderVolumes-1862722151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fe75dd7-9621-4214-88b2-b027d21b304d', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Lock "cinder-b8462168-4ca7-4b97-938f-261e8d9f5261-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:26 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-17a6a666-bd26-4258-aa22-09b9201986fc" returned: 0 in 0.304s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Acquiring lock "cinder-quobyte-b8462168-4ca7-4b97-938f-261e8d9f5261" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Lock "cinder-quobyte-17a6a666-bd26-4258-aa22-09b9201986fc" released by "delete_volume" :: held 0.788s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Lock "cinder-quobyte-b8462168-4ca7-4b97-938f-261e8d9f5261" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-fe8372be-3e71-4017-af16-1482eb61f79b req-e8a6c5e7-6aa1-47d1-a8dd-219c619388c6 tempest-TestInstancesWithCinderVolumes-1862722151 None] attachment_update completed successfully. Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10b5c1a-b9f9-4422-af33-dae2654449b9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Created reservations ['395f2b5a-6886-42e4-9e07-b68f943b036b', '4104251f-2180-4721-bb1a-8aa96831b70f', '2face328-729b-4418-82a1-15eeb6573196', '2f6a7c76-cbe9-4ae2-88f7-260fe26fb3b2'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 Nov 03 17:04:26 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:04:26 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:27 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.379s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Deleted volume successfully. Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8caeaac6-334d-4ac6-871a-65388b2e25e9 tempest-TestImageHashVerification-1981639934 None] Lock "cinder-17a6a666-bd26-4258-aa22-09b9201986fc-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:27 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261" returned: 0 in 0.687s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:27 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261 Nov 03 17:04:27 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:27 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8462168-4ca7-4b97-938f-261e8d9f5261" returned: 0 in 0.355s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Lock "cinder-quobyte-b8462168-4ca7-4b97-938f-261e8d9f5261" released by "delete_volume" :: held 1.101s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Created reservations ['abd44017-1fb8-4581-8c28-cf5fc54e4f30', 'd346639c-5103-49ea-818d-332557440c4c', '51a2921c-e8db-4293-b4da-01710c6fa206', '19088fa2-9dcf-4d5b-a600-53d84d06068f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:27 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:04:27 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:28 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.390s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Deleted volume successfully. Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-123d6dbb-d9f8-4ee8-ae0f-b053c79938cb tempest-VolumesServicesTestJSON-1203687185 None] Lock "cinder-b8462168-4ca7-4b97-938f-261e8d9f5261-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Acquiring lock "cinder-0f24b08d-e6b6-4f52-b7af-5fcad156a87d-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "cinder-0f24b08d-e6b6-4f52-b7af-5fcad156a87d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Acquiring lock "cinder-quobyte-0f24b08d-e6b6-4f52-b7af-5fcad156a87d" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "cinder-quobyte-0f24b08d-e6b6-4f52-b7af-5fcad156a87d" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d94e44-1acc-4f90-a3e8-2fd07d676459]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:28 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d Nov 03 17:04:28 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:29 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d" returned: 0 in 0.505s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:29 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d Nov 03 17:04:29 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:29 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0f24b08d-e6b6-4f52-b7af-5fcad156a87d" returned: 0 in 0.343s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "cinder-quobyte-0f24b08d-e6b6-4f52-b7af-5fcad156a87d" released by "delete_volume" :: held 0.904s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Created reservations ['8b59c4f5-3ab9-4487-8356-6bd3f46208c5', '5a4dd3cc-93cd-4056-aea2-1156b5bd4cdd', '83210330-a9f0-4516-9f2a-35084f10ed3a', '1f1091a4-b49c-478c-9965-e04507da44bc'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-1574fa24-2598-48e7-9a31-ae70301f2187 req-ed2d40d0-be2c-43e3-8199-2aa1f03625b8 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-1574fa24-2598-48e7-9a31-ae70301f2187 req-ed2d40d0-be2c-43e3-8199-2aa1f03625b8 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:29 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:04:29 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-1574fa24-2598-48e7-9a31-ae70301f2187 req-ed2d40d0-be2c-43e3-8199-2aa1f03625b8 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-1574fa24-2598-48e7-9a31-ae70301f2187 req-ed2d40d0-be2c-43e3-8199-2aa1f03625b8 tempest-TestInstancesWithCinderVolumes-1862722151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-4ad24b9b-7fd8-4821-8208-3b128aa92105', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32a2ee44-974f-4c89-8b67-35ba98f74c3b', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:04:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-1574fa24-2598-48e7-9a31-ae70301f2187 req-ed2d40d0-be2c-43e3-8199-2aa1f03625b8 tempest-TestInstancesWithCinderVolumes-1862722151 None] attachment_update completed successfully. Nov 03 17:04:30 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.348s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:30 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Deleted volume successfully. Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4c275c15-09c7-4eb9-beb8-faa7707d223d tempest-VolumeQuotasNegativeTestJSON-1868815046 None] Lock "cinder-0f24b08d-e6b6-4f52-b7af-5fcad156a87d-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:30 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:04:30 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:31 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.339s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:04:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:04:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:04:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-29b737c9-ccde-4576-adc2-94c36bcbe6c2 req-ef60dcbb-8516-40fd-9ee7-bf790e9d8b4a tempest-TestInstancesWithCinderVolumes-1862722151 None] Terminate volume connection completed successfully. Nov 03 17:04:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-29b737c9-ccde-4576-adc2-94c36bcbe6c2 req-ef60dcbb-8516-40fd-9ee7-bf790e9d8b4a tempest-TestInstancesWithCinderVolumes-1862722151 None] Deleting attachment 5fe75dd7-9621-4214-88b2-b027d21b304d. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:04:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "cinder-e7f9301e-0c36-45ec-a37d-ff96a76fa92e-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-e7f9301e-0c36-45ec-a37d-ff96a76fa92e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "cinder-quobyte-e7f9301e-0c36-45ec-a37d-ff96a76fa92e" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-quobyte-e7f9301e-0c36-45ec-a37d-ff96a76fa92e" acquired by "delete_volume" :: waited 0.032s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[93caa494-c0af-4df5-aab7-58c3787c672b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:37 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e Nov 03 17:04:37 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:38 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e" returned: 0 in 0.599s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:38 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e Nov 03 17:04:38 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:38 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e7f9301e-0c36-45ec-a37d-ff96a76fa92e" returned: 0 in 0.461s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-quobyte-e7f9301e-0c36-45ec-a37d-ff96a76fa92e" released by "delete_volume" :: held 1.136s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:38 devstack cinder-volume[86939]: WARNING cinder.quota [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-739554632-634764955 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-739554632-634764955, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:38 devstack cinder-volume[86939]: WARNING cinder.quota [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-739554632-634764955 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-739554632-634764955, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Created reservations ['285e458e-ad3e-4282-9c1f-85a03d83503c', 'b353059b-e1a6-481b-926e-4df73a5fbe68', 'd7fdd66e-7282-4e8a-a001-4982d74bb00e', '63598a50-089a-487e-be8b-bf8ccf91b075'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:39 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:04:39 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:39 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.453s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Deleted volume successfully. Nov 03 17:04:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a8832c3c-bb0c-4911-b42c-9fce6d13a71e tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-e7f9301e-0c36-45ec-a37d-ff96a76fa92e-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-bdb24395-cbad-4769-99f0-7c92b3758911 req-843897f9-15da-47de-a08f-0f2d7a33a2fd tempest-TestInstancesWithCinderVolumes-1862722151 None] Terminate volume connection completed successfully. Nov 03 17:04:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-bdb24395-cbad-4769-99f0-7c92b3758911 req-843897f9-15da-47de-a08f-0f2d7a33a2fd tempest-TestInstancesWithCinderVolumes-1862722151 None] Deleting attachment 32a2ee44-974f-4c89-8b67-35ba98f74c3b. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:04:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "cinder-4ad24b9b-7fd8-4821-8208-3b128aa92105-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-4ad24b9b-7fd8-4821-8208-3b128aa92105-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "cinder-quobyte-4ad24b9b-7fd8-4821-8208-3b128aa92105" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-quobyte-4ad24b9b-7fd8-4821-8208-3b128aa92105" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd289076-47d9-4bdd-876b-b113f98903fa]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:43 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 Nov 03 17:04:43 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:44 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105" returned: 0 in 0.601s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:44 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105 Nov 03 17:04:44 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:44 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4ad24b9b-7fd8-4821-8208-3b128aa92105" returned: 0 in 0.384s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-quobyte-4ad24b9b-7fd8-4821-8208-3b128aa92105" released by "delete_volume" :: held 1.067s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:44 devstack cinder-volume[86939]: WARNING cinder.quota [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-325178277-1454599799 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-325178277-1454599799, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:44 devstack cinder-volume[86939]: WARNING cinder.quota [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-325178277-1454599799 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-325178277-1454599799, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Created reservations ['bb46647a-b02d-46cd-99b5-517061b74d50', '600dfe0e-4856-402e-b5a6-726fdac79a80', 'd3b6eb03-934e-46a2-8403-ee1135404007', 'ba9aff58-2528-4067-a4fa-517801e281df'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:45 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:04:45 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:45 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.442s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:45 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Deleted volume successfully. Nov 03 17:04:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-175ce03a-5819-4d69-a081-2087efda9912 tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-4ad24b9b-7fd8-4821-8208-3b128aa92105-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Flow 'volume_create_manager' (a065e5d7-46bd-477f-a289-495f64076ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f76488-cf25-4fd6-a49a-28a07ad22ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f76488-cf25-4fd6-a49a-28a07ad22ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1848655218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa81b46-41b9-4b31-b53e-36a8612ed409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f3b5152e3e4ae190f0f043648d94f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:48Z,use_quota=True,user_id='a21a51b1b1334e7fa3425dfa3ed76e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ca8a60-63a6-4857-85b6-1a911f65271a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ca8a60-63a6-4857-85b6-1a911f65271a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f6b0e2-54d0-4a40-9f1a-9c816b328445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f6b0e2-54d0-4a40-9f1a-9c816b328445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa81b46-41b9-4b31-b53e-36a8612ed409', 'volume_name': 'volume-0fa81b46-41b9-4b31-b53e-36a8612ed409', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b63e798-b874-4467-8341-de338a75f9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b63e798-b874-4467-8341-de338a75f9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c59414-acc5-4faa-8dae-076070d31153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:47 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Volume 0fa81b46-41b9-4b31-b53e-36a8612ed409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa81b46-41b9-4b31-b53e-36a8612ed409', 'volume_size': 1} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1848655218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa81b46-41b9-4b31-b53e-36a8612ed409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f3b5152e3e4ae190f0f043648d94f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:48Z,use_quota=True,user_id='a21a51b1b1334e7fa3425dfa3ed76e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Creating volume 0fa81b46-41b9-4b31-b53e-36a8612ed409 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:47 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:04:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:47 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 1073741824 Nov 03 17:04:47 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:48 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 1073741824" returned: 0 in 0.867s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:48 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 Nov 03 17:04:48 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:49 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409" returned: 0 in 0.595s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c59414-acc5-4faa-8dae-076070d31153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa81b46-41b9-4b31-b53e-36a8612ed409', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3b398c-4e0a-4d28-9e8b-fdb64d086856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:49 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Volume volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 (0fa81b46-41b9-4b31-b53e-36a8612ed409): created successfully Nov 03 17:04:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3b398c-4e0a-4d28-9e8b-fdb64d086856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Flow 'volume_create_manager' (a065e5d7-46bd-477f-a289-495f64076ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ebf7f58d-815e-4c42-bba7-cec594592fe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Created volume successfully. Nov 03 17:04:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Creating offline snapshot 5fb9a440-4825-4ccd-b3d8-8a41fadebf09 of volume 0fa81b46-41b9-4b31-b53e-36a8612ed409 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:04:50 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aaa878-c661-4b60-8ebf-4b7633b5b014]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:50 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 Nov 03 17:04:50 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:50 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409" returned: 0 in 0.539s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:50 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 1G Nov 03 17:04:50 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:51 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 1G" returned: 0 in 0.638s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:51 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 Nov 03 17:04:51 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:51 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09" returned: 0 in 0.391s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:51 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 is being set with open permissions: ugo+rw Nov 03 17:04:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:51 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 Nov 03 17:04:51 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:52 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09" returned: 0 in 0.369s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:52 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-19c43a5a-8579-465b-b9e5-f8d8e521c696 req-eb5ea819-f0df-4ff8-8303-cc60926174ac tempest-TestInstancesWithCinderVolumes-1862722151 None] Terminate volume connection completed successfully. Nov 03 17:04:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-19c43a5a-8579-465b-b9e5-f8d8e521c696 req-eb5ea819-f0df-4ff8-8303-cc60926174ac tempest-TestInstancesWithCinderVolumes-1862722151 None] Deleting attachment b16ebd7e-0f6f-4dee-9c68-c06454f24806. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:04:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:52 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.info Nov 03 17:04:52 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:52 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.info" returned: 0 in 0.367s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:52 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.info is being set with open permissions: ugo+rw Nov 03 17:04:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:52 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.info Nov 03 17:04:52 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:53 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.info" returned: 0 in 0.461s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.912s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:53 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f7b5b161-6ad0-48af-b2ef-b5bbb499f17c tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Create snapshot completed successfully Nov 03 17:04:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "cinder-38f5ed96-276c-4c26-a7de-8139005907ea-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-38f5ed96-276c-4c26-a7de-8139005907ea-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "cinder-quobyte-38f5ed96-276c-4c26-a7de-8139005907ea" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-quobyte-38f5ed96-276c-4c26-a7de-8139005907ea" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:53 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4b457-a673-4a8f-ae06-5b98cef87f31]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:53 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea Nov 03 17:04:53 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:54 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea" returned: 0 in 0.642s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:54 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea Nov 03 17:04:54 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "cinder-5fb9a440-4825-4ccd-b3d8-8a41fadebf09-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-5fb9a440-4825-4ccd-b3d8-8a41fadebf09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "cinder-quobyte-0fa81b46-41b9-4b31-b53e-36a8612ed409" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-quobyte-0fa81b46-41b9-4b31-b53e-36a8612ed409" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "cinder-quobyte-5fb9a440-4825-4ccd-b3d8-8a41fadebf09" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-quobyte-5fb9a440-4825-4ccd-b3d8-8a41fadebf09" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Deleting offline snapshot 5fb9a440-4825-4ccd-b3d8-8a41fadebf09 of volume 0fa81b46-41b9-4b31-b53e-36a8612ed409 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] snapshot_file for this snap is: volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b05248-2436-42ad-a588-1664a4ae8895]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:54 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 Nov 03 17:04:54 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:54 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-38f5ed96-276c-4c26-a7de-8139005907ea" returned: 0 in 0.416s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-quobyte-38f5ed96-276c-4c26-a7de-8139005907ea" released by "delete_volume" :: held 1.142s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:54 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770584781-1692905909 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770584781-1692905909, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:54 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770584781-1692905909 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770584781-1692905909, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Created reservations ['14fcb706-dfa7-4a31-aa79-480366aaafba', 'fd1c72cc-954f-47c7-8a69-ebf1a0a7e2dc', '75ce608a-4a46-40c8-8018-2c9b814c147a', 'f0d2419b-7f48-41a0-85c4-388901a9c98b'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:54 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:04:54 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:55 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09" returned: 0 in 0.597s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa81b46-41b9-4b31-b53e-36a8612ed409(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb446c0-9421-4779-8f89-8ccf561f2f34]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:55 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 Nov 03 17:04:55 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:55 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.427s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:55 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Deleted volume successfully. Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0712d007-ee31-445a-a13f-d7c0026e534a tempest-TestInstancesWithCinderVolumes-1862722151 None] Lock "cinder-38f5ed96-276c-4c26-a7de-8139005907ea-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:55 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409" returned: 0 in 0.507s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:55 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 Nov 03 17:04:55 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:56 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09" returned: 0 in 0.600s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:56 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09 Nov 03 17:04:56 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:56 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409.5fb9a440-4825-4ccd-b3d8-8a41fadebf09" returned: 0 in 0.398s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:56 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=60,cinder:UPDATE=67,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:04:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-quobyte-5fb9a440-4825-4ccd-b3d8-8a41fadebf09" released by "_delete_snapshot" :: held 2.308s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-quobyte-0fa81b46-41b9-4b31-b53e-36a8612ed409" released by "delete_snapshot" :: held 2.347s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:56 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Created reservations ['f3506b48-918b-481c-806d-a2c9289bed90', '2ac87691-e365-4f72-bf8a-99f9b17a2a0e', '4c41310c-003e-4530-8f1f-9410685e69b8', '0a6fa3f5-b931-4d86-a225-de14dfaf9bd6'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:56 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Delete snapshot completed successfully. Nov 03 17:04:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b4699899-7392-48cc-a8c3-83e8b60b8ea6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-5fb9a440-4825-4ccd-b3d8-8a41fadebf09-delete_snapshot" released by "delete_snapshot" :: held 2.685s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "cinder-0fa81b46-41b9-4b31-b53e-36a8612ed409-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-0fa81b46-41b9-4b31-b53e-36a8612ed409-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "cinder-quobyte-0fa81b46-41b9-4b31-b53e-36a8612ed409" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-quobyte-0fa81b46-41b9-4b31-b53e-36a8612ed409" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:57 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72542b8-eaa5-485d-a1b7-7ce8012b94f2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:57 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 Nov 03 17:04:57 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:58 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409" returned: 0 in 0.471s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:58 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409 Nov 03 17:04:58 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:58 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0fa81b46-41b9-4b31-b53e-36a8612ed409" returned: 0 in 0.306s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-quobyte-0fa81b46-41b9-4b31-b53e-36a8612ed409" released by "delete_volume" :: held 0.870s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=60,cinder:UPDATE=64,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Created reservations ['6f429b90-1f76-4e2e-9a5e-7b57e06969b9', '75dd8df8-69f4-4c1c-8719-b91da8ba4e55', '844f95d7-4fbd-44b1-982a-fb5ed4d12aab', '6626522b-0a85-4188-a936-84c94985592d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:58 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:04:58 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:59 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:59 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Deleted volume successfully. Nov 03 17:04:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-47dd27a6-ddc3-4929-b546-9223fd9b5cbe tempest-VolumeSnapshotQuotasNegativeTestJSON-1889295800 None] Lock "cinder-0fa81b46-41b9-4b31-b53e-36a8612ed409-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:08 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=8,cinder:SELECT=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Flow 'volume_create_manager' (e7850183-08de-4563-ad9c-8aaed21230b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffdbd6d-2719-441e-95bf-b916173fcd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffdbd6d-2719-441e-95bf-b916173fcd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1573130102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea31f2d4-b646-4419-bfe8-e321c84d1033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebc93b15aac40849348421b683fa383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:10Z,use_quota=True,user_id='49169f6182e649e9badcd8e10280786f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ce798e2-78ed-445a-89c6-56e334875271),volume_type_id=1ce798e2-78ed-445a-89c6-56e334875271)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a76b45c-d7a3-4122-8226-1370abb39022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a76b45c-d7a3-4122-8226-1370abb39022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c13a53-4711-4d50-addf-0965f9ba74ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c13a53-4711-4d50-addf-0965f9ba74ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea31f2d4-b646-4419-bfe8-e321c84d1033', 'volume_name': 'volume-ea31f2d4-b646-4419-bfe8-e321c84d1033', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6957b4-b8ce-47bf-a1e9-36999bc49151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6957b4-b8ce-47bf-a1e9-36999bc49151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9093c55b-5b41-495d-a9c8-5fdf902ed987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Volume ea31f2d4-b646-4419-bfe8-e321c84d1033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea31f2d4-b646-4419-bfe8-e321c84d1033', 'volume_size': 1} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1573130102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea31f2d4-b646-4419-bfe8-e321c84d1033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebc93b15aac40849348421b683fa383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:10Z,use_quota=True,user_id='49169f6182e649e9badcd8e10280786f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ce798e2-78ed-445a-89c6-56e334875271),volume_type_id=1ce798e2-78ed-445a-89c6-56e334875271)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Creating volume ea31f2d4-b646-4419-bfe8-e321c84d1033 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:10 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:10 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 1073741824 Nov 03 17:05:10 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:10 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 1073741824" returned: 0 in 0.600s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:10 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 Nov 03 17:05:10 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:10 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033" returned: 0 in 0.303s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9093c55b-5b41-495d-a9c8-5fdf902ed987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea31f2d4-b646-4419-bfe8-e321c84d1033', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f50131-ed33-484a-99f2-488c42fdb62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:11 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Volume volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 (ea31f2d4-b646-4419-bfe8-e321c84d1033): created successfully Nov 03 17:05:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f50131-ed33-484a-99f2-488c42fdb62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Flow 'volume_create_manager' (e7850183-08de-4563-ad9c-8aaed21230b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9f54d02b-6a74-4bee-a051-9a310586164b tempest-VolumeTypesAccessTest-1845223055 None] Created volume successfully. Nov 03 17:05:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Acquiring lock "cinder-ea31f2d4-b646-4419-bfe8-e321c84d1033-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Lock "cinder-ea31f2d4-b646-4419-bfe8-e321c84d1033-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Acquiring lock "cinder-quobyte-ea31f2d4-b646-4419-bfe8-e321c84d1033" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Lock "cinder-quobyte-ea31f2d4-b646-4419-bfe8-e321c84d1033" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f69740-6a56-4d04-b614-c9a00d3de060]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:12 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 Nov 03 17:05:12 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:12 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033" returned: 0 in 0.431s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:12 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033 Nov 03 17:05:12 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:13 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ea31f2d4-b646-4419-bfe8-e321c84d1033" returned: 0 in 0.376s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Lock "cinder-quobyte-ea31f2d4-b646-4419-bfe8-e321c84d1033" released by "delete_volume" :: held 0.861s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:13 devstack cinder-volume[86939]: WARNING cinder.quota [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1505393570 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1505393570, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:13 devstack cinder-volume[86939]: WARNING cinder.quota [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1505393570 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1505393570, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Created reservations ['7528e4d2-1c11-44f1-8b9d-a4374c5a8276', 'd9bdf83a-47db-41ee-bac3-ce99362b7eff', 'f666323c-6aed-4117-88ac-afc84baa3dd1', 'f12aec7a-e2f4-40d5-9ca0-18e269367da3'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:13 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:05:13 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:13 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.455s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Deleted volume successfully. Nov 03 17:05:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee8ec4ba-2f09-4cfd-b820-f5b80eb4db5a tempest-VolumeTypesAccessTest-1845223055 None] Lock "cinder-ea31f2d4-b646-4419-bfe8-e321c84d1033-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:17 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Flow 'volume_create_manager' (5935973b-060b-4f44-a451-53b0dcf0cb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17069cc1-9b66-4498-8bd7-121e7ecae69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17069cc1-9b66-4498-8bd7-121e7ecae69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-392804078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a6b353-f579-4b95-a180-9d8d78eabcf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30595fb160da4abd9341e00ac3e22311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:18Z,use_quota=True,user_id='5417ba3f955340d08766009e025f1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e32b74a-43ca-4cf8-ba1a-c5de83c06f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e32b74a-43ca-4cf8-ba1a-c5de83c06f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed6eab6-8490-4c32-bef5-db1811c5a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed6eab6-8490-4c32-bef5-db1811c5a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a6b353-f579-4b95-a180-9d8d78eabcf4', 'volume_name': 'volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af64cd8-db4b-4391-8056-0e9d495ee188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af64cd8-db4b-4391-8056-0e9d495ee188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce53888d-c5a4-4437-8fa1-44f07c217239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Volume f6a6b353-f579-4b95-a180-9d8d78eabcf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4', 'volume_size': 1} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-392804078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a6b353-f579-4b95-a180-9d8d78eabcf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30595fb160da4abd9341e00ac3e22311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:18Z,use_quota=True,user_id='5417ba3f955340d08766009e025f1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Creating volume f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:18 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:18 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 1073741824 Nov 03 17:05:18 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:18 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 1073741824" returned: 0 in 0.651s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:18 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 Nov 03 17:05:18 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:19 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4" returned: 0 in 0.370s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce53888d-c5a4-4437-8fa1-44f07c217239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c56af1-cb09-4474-a7f2-d2cf64e2d1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Volume volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 (f6a6b353-f579-4b95-a180-9d8d78eabcf4): created successfully Nov 03 17:05:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c56af1-cb09-4474-a7f2-d2cf64e2d1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Flow 'volume_create_manager' (5935973b-060b-4f44-a451-53b0dcf0cb9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c501b1c0-ef27-4f07-b674-26273669e03c tempest-TestStampPattern-124371638 None] Created volume successfully. Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Flow 'volume_create_manager' (73cd4cd1-08da-4dce-8398-79471034a2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020fc84c-cb97-4d8f-a323-ef82a774fc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020fc84c-cb97-4d8f-a323-ef82a774fc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1716452018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5f2f185c1e43589da96cd3d96a6095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:25Z,use_quota=True,user_id='18a15ab08036432a8e54f78ce31dc52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00eed04f-3dc5-4e7b-a7c2-04f5dcee1a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00eed04f-3dc5-4e7b-a7c2-04f5dcee1a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc62229b-4592-455f-9a19-bce780692f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc62229b-4592-455f-9a19-bce780692f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3', 'volume_name': 'volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8168c1-2247-41bb-89ae-c276f0010bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8168c1-2247-41bb-89ae-c276f0010bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1239448-c283-4c7b-8b32-4a7f838f4a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:25 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Volume f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:05:25 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Trying to clone f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 from image d3081758-5b01-49fb-b109-4441003b66a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:05:26 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:05:26 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:05:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bbcd6e-f060-4c06-97e0-aeba13189a7a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:26 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD Nov 03 17:05:26 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:26 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:26 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 is fetched for user 18a15ab08036432a8e54f78ce31dc52f. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe4b9c-1454-4769-9af8-87d5f54c6ae7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:27 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD Nov 03 17:05:27 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:27 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1716452018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5f2f185c1e43589da96cd3d96a6095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:25Z,use_quota=True,user_id='18a15ab08036432a8e54f78ce31dc52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Creating volume f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:27 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:05:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:27 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 1073741824 Nov 03 17:05:27 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:28 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 1073741824" returned: 0 in 0.602s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:28 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 Nov 03 17:05:28 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:28 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3" returned: 0 in 0.305s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Attempting download of d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e3fbbf-8c75-41cb-8fa0-0ee6013e235a]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dnwe3kq2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:28 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dnwe3kq2 Nov 03 17:05:28 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:28 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dnwe3kq2" returned: 0 in 0.347s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dnwe3kq2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:29 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dnwe3kq2 Nov 03 17:05:29 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:29 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dnwe3kq2" returned: 1 in 0.515s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_dnwe3kq2' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:05:29 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[780573ef-80e5-47fe-8e27-3ad99624889a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:29 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD Nov 03 17:05:29 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:29 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:29 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] d3081758-5b01-49fb-b109-4441003b66a8 was qcow2, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:05:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:29 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 Nov 03 17:05:29 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:05:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:30 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:05:30 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:31 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.396s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:05:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:05:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:05:32 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3" returned: 0 in 2.620s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:32 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_qhqxq85tdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:05:32 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Converted 112.00 MB image at 42.74 MB/s Nov 03 17:05:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:32 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 1G Nov 03 17:05:32 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:32 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 1G" returned: 0 in 0.551s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:32 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Downloaded image d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:05:33 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 for user 18a15ab08036432a8e54f78ce31dc52f is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:05:33 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Marking volume f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:05:33 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Copying metadata from image d3081758-5b01-49fb-b109-4441003b66a8 to f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:05:33 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Creating volume glance metadata for volume f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 backed by image d3081758-5b01-49fb-b109-4441003b66a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:05:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1239448-c283-4c7b-8b32-4a7f838f4a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5dc986-8c84-4756-b1e4-c7638716e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:33 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Volume volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 (f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3): created successfully Nov 03 17:05:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5dc986-8c84-4756-b1e4-c7638716e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Flow 'volume_create_manager' (73cd4cd1-08da-4dce-8398-79471034a2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2a3cb74d-e05a-4c0a-9c39-ee448e2b0171 tempest-VolumesImageMetadata-280227409 None] Created volume successfully. Nov 03 17:05:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Acquiring lock "cinder-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Lock "cinder-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Acquiring lock "cinder-quobyte-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Lock "cinder-quobyte-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:35 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e95bcc-d3b0-405c-91b1-0e4b23602d1b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:35 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 Nov 03 17:05:35 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:35 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3" returned: 0 in 0.494s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:35 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3 Nov 03 17:05:35 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:35 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3" returned: 0 in 0.336s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Lock "cinder-quobyte-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3" released by "delete_volume" :: held 0.906s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:35 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Created reservations ['e04a64b4-9952-43fa-b901-077f4a413489', '9622d255-9786-4fe7-9c56-f3cb82f15719', '7ac0467e-4ba6-4cc1-abbe-046957207b80', '90a5a8b7-2d14-42d0-829c-8017bb109449'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:36 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:05:36 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:36 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.623s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Deleted volume successfully. Nov 03 17:05:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-51f921de-7574-4923-8634-556ce4849588 tempest-VolumesImageMetadata-280227409 None] Lock "cinder-f2e3cec4-cefa-4eb7-8987-bb28a7f9a9d3-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Flow 'volume_create_manager' (e4912cf7-dcd0-4c80-a8dd-8602d8161926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f303023c-e14a-4525-ae6d-d85c056fc6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f303023c-e14a-4525-ae6d-d85c056fc6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2118629011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6000d27-04e6-4804-b139-171fe7465545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d58075265c4fcfaee241d3ac21d9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:45Z,use_quota=True,user_id='bd378fd0ff18499292c7b23f15af68f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539a5b9e-ccd5-4131-b47b-d0db6d7dede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539a5b9e-ccd5-4131-b47b-d0db6d7dede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8fbe7c-ec37-4f0d-8814-ae453f7887c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8fbe7c-ec37-4f0d-8814-ae453f7887c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6000d27-04e6-4804-b139-171fe7465545', 'volume_name': 'volume-f6000d27-04e6-4804-b139-171fe7465545', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4563d09-5fcb-4c7b-9c50-524a51409357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4563d09-5fcb-4c7b-9c50-524a51409357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655f5cca-754b-402a-bad8-cb82b9fcdac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Volume f6000d27-04e6-4804-b139-171fe7465545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6000d27-04e6-4804-b139-171fe7465545', 'volume_size': 1} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2118629011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6000d27-04e6-4804-b139-171fe7465545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d58075265c4fcfaee241d3ac21d9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:45Z,use_quota=True,user_id='bd378fd0ff18499292c7b23f15af68f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Creating volume f6000d27-04e6-4804-b139-171fe7465545 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:44 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:05:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:44 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 1073741824 Nov 03 17:05:44 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:45 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 1073741824" returned: 0 in 0.681s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:45 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 Nov 03 17:05:45 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:45 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545" returned: 0 in 0.378s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655f5cca-754b-402a-bad8-cb82b9fcdac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6000d27-04e6-4804-b139-171fe7465545', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93451109-8749-448e-8b95-a8b6ddc1c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:46 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Volume volume-f6000d27-04e6-4804-b139-171fe7465545 (f6000d27-04e6-4804-b139-171fe7465545): created successfully Nov 03 17:05:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93451109-8749-448e-8b95-a8b6ddc1c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Flow 'volume_create_manager' (e4912cf7-dcd0-4c80-a8dd-8602d8161926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cf7c6f9f-6973-48b1-b68e-7003619bcd8d tempest-SnapshotMetadataTestJSON-624815769 None] Created volume successfully. Nov 03 17:05:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Creating offline snapshot 203016ef-e62e-4429-a4a2-e48e9f1d7180 of volume f6000d27-04e6-4804-b139-171fe7465545 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:05:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c39950-4f09-4611-a814-3dda241d0a5f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:47 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 Nov 03 17:05:47 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:47 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545" returned: 0 in 0.483s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:47 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 1G Nov 03 17:05:47 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:48 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 1G" returned: 0 in 0.615s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6000d27-04e6-4804-b139-171fe7465545 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:48 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6000d27-04e6-4804-b139-171fe7465545 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 Nov 03 17:05:48 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:48 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6000d27-04e6-4804-b139-171fe7465545 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180" returned: 0 in 0.549s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:48 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 is being set with open permissions: ugo+rw Nov 03 17:05:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:49 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 Nov 03 17:05:49 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:49 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180" returned: 0 in 0.283s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:49 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.info Nov 03 17:05:49 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:49 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.info" returned: 0 in 0.506s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:49 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.info is being set with open permissions: ugo+rw Nov 03 17:05:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:49 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.info Nov 03 17:05:49 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:50 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.info" returned: 0 in 0.475s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.110s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:50 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-eeb5ff59-4bfb-4e07-9ff9-e17efee8b15f tempest-SnapshotMetadataTestJSON-624815769 None] Create snapshot completed successfully Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "cinder-203016ef-e62e-4429-a4a2-e48e9f1d7180-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-203016ef-e62e-4429-a4a2-e48e9f1d7180-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "cinder-quobyte-f6000d27-04e6-4804-b139-171fe7465545" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-quobyte-f6000d27-04e6-4804-b139-171fe7465545" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "cinder-quobyte-203016ef-e62e-4429-a4a2-e48e9f1d7180" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-quobyte-203016ef-e62e-4429-a4a2-e48e9f1d7180" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Deleting offline snapshot 203016ef-e62e-4429-a4a2-e48e9f1d7180 of volume f6000d27-04e6-4804-b139-171fe7465545 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] snapshot_file for this snap is: volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c34f72-1043-4ae0-a5db-3141d9497cf9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:52 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 Nov 03 17:05:52 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:53 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180" returned: 0 in 0.503s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6000d27-04e6-4804-b139-171fe7465545(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:05:53 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[16691378-f36e-4a73-a926-0bf3fee3c86e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:53 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 Nov 03 17:05:53 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:53 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545" returned: 0 in 0.537s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:54 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 Nov 03 17:05:54 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:54 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180" returned: 0 in 0.514s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:54 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180 Nov 03 17:05:54 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:54 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545.203016ef-e62e-4429-a4a2-e48e9f1d7180" returned: 0 in 0.378s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-quobyte-203016ef-e62e-4429-a4a2-e48e9f1d7180" released by "_delete_snapshot" :: held 2.111s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-quobyte-f6000d27-04e6-4804-b139-171fe7465545" released by "delete_snapshot" :: held 2.144s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:55 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Created reservations ['7b10025b-e2db-432f-b6c2-bfe50f6cb85b', '5e3dbf5b-e209-4088-a180-82d1f5cd472c', '2cc2f1ca-ffa4-4067-8c71-efee0e150567', 'fdd093e8-ae8d-4bac-821c-a8caae0dc383'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:55 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Delete snapshot completed successfully. Nov 03 17:05:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1ab87742-9d9a-46a9-bd67-0b6edc061e69 tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-203016ef-e62e-4429-a4a2-e48e9f1d7180-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "cinder-f6000d27-04e6-4804-b139-171fe7465545-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-f6000d27-04e6-4804-b139-171fe7465545-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "cinder-quobyte-f6000d27-04e6-4804-b139-171fe7465545" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-quobyte-f6000d27-04e6-4804-b139-171fe7465545" acquired by "delete_volume" :: waited 0.040s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:56 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[545a8900-dd0c-4af3-b97c-6fb559c14ebf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:56 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 Nov 03 17:05:56 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:56 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545" returned: 0 in 0.520s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:56 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545 Nov 03 17:05:56 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:57 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6000d27-04e6-4804-b139-171fe7465545" returned: 0 in 0.439s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-quobyte-f6000d27-04e6-4804-b139-171fe7465545" released by "delete_volume" :: held 1.085s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Created reservations ['453580b6-e063-426c-a550-39fb2181d8e7', 'c36e806f-a332-4eb0-b228-d19f1fe49b81', 'da387e6a-848d-460a-935d-013753841220', '71799aed-e71e-4344-b6d1-17eedadc1859'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:57 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:05:57 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:57 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.342s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Deleted volume successfully. Nov 03 17:05:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-919dbb39-82af-4b04-96d6-af1456aa946d tempest-SnapshotMetadataTestJSON-624815769 None] Lock "cinder-f6000d27-04e6-4804-b139-171fe7465545-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-2df3458e-152a-4f59-8e1b-a44a432dd8f9 req-8ca8bfc5-1422-4554-9ed7-2b85ce091631 tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-2df3458e-152a-4f59-8e1b-a44a432dd8f9 req-8ca8bfc5-1422-4554-9ed7-2b85ce091631 tempest-TestStampPattern-124371638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-2df3458e-152a-4f59-8e1b-a44a432dd8f9 req-8ca8bfc5-1422-4554-9ed7-2b85ce091631 tempest-TestStampPattern-124371638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-2df3458e-152a-4f59-8e1b-a44a432dd8f9 req-8ca8bfc5-1422-4554-9ed7-2b85ce091631 tempest-TestStampPattern-124371638 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce59ae24-224d-49a9-8e68-287a244573b7', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:06:02 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-2df3458e-152a-4f59-8e1b-a44a432dd8f9 req-8ca8bfc5-1422-4554-9ed7-2b85ce091631 tempest-TestStampPattern-124371638 None] attachment_update completed successfully. Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Flow 'volume_create_manager' (5ecfce4a-c9bf-4eb3-99e4-314303574c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb944c5f-3943-4c91-87c5-55acd6df537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb944c5f-3943-4c91-87c5-55acd6df537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1273863629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882d879677f749ffb29909451a3158ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:05Z,use_quota=True,user_id='137d3e0435f3430cabf18c072dd4f8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd679721-b7f1-4713-bed0-916b8d959045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd679721-b7f1-4713-bed0-916b8d959045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053680bf-5509-4aaa-a719-6c8207407db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053680bf-5509-4aaa-a719-6c8207407db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421', 'volume_name': 'volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20285624-b9e6-4240-82c9-a72fcdaeda9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20285624-b9e6-4240-82c9-a72fcdaeda9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e958827-6105-4b5e-a23b-cfd6937e3c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Volume 1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421', 'volume_size': 1} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1273863629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882d879677f749ffb29909451a3158ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:05Z,use_quota=True,user_id='137d3e0435f3430cabf18c072dd4f8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Creating volume 1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:05 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:06:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:05 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 1073741824 Nov 03 17:06:05 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:06 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 1073741824" returned: 0 in 0.939s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:06 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 Nov 03 17:06:06 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:07 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421" returned: 0 in 0.658s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e958827-6105-4b5e-a23b-cfd6937e3c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ee1795-8e1b-42b3-b449-6996dc0b01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Volume volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 (1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421): created successfully Nov 03 17:06:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ee1795-8e1b-42b3-b449-6996dc0b01f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Flow 'volume_create_manager' (5ecfce4a-c9bf-4eb3-99e4-314303574c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e9160a6f-0766-4e86-ab61-09aadda93cc6 tempest-VolumesMetadataTest-510735757 None] Created volume successfully. Nov 03 17:06:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Acquiring lock "cinder-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Lock "cinder-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:09 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=47,cinder:UPDATE=54,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:06:09 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=46,cinder:SELECT=51,cinder:DELETE=3,cinder:INSERT=18 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:06:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Acquiring lock "cinder-quobyte-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Lock "cinder-quobyte-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421" acquired by "delete_volume" :: waited 0.070s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:09 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecfee7e-05c0-4227-bd3d-a738e736961e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:09 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 Nov 03 17:06:09 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:10 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-62e0b2a9-7131-441d-b5de-96dd7de7b76d req-05af77f2-369e-474a-ab79-5e9c95846915 tempest-TestStampPattern-124371638 None] Terminate volume connection completed successfully. Nov 03 17:06:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-62e0b2a9-7131-441d-b5de-96dd7de7b76d req-05af77f2-369e-474a-ab79-5e9c95846915 tempest-TestStampPattern-124371638 None] Deleting attachment ce59ae24-224d-49a9-8e68-287a244573b7. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:06:10 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421" returned: 0 in 0.669s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:10 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421 Nov 03 17:06:10 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:10 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421" returned: 0 in 0.706s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Lock "cinder-quobyte-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421" released by "delete_volume" :: held 1.484s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Creating offline snapshot 2dbf808e-d639-4404-819f-c270b2bf9ffc of volume f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Created reservations ['4212430c-6688-4c2c-844f-2131620f5de2', '400e8790-d7ea-4939-8539-130100df019f', '781211aa-1d16-47d7-b2a7-e009dee323cf', '333dc253-0a7f-4a19-9705-616eba42e2b4'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e6d205-d55e-4834-a6cc-4dd3b7f360d9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:11 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 Nov 03 17:06:11 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:11 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:06:11 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:11 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4" returned: 0 in 0.711s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:12 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc 1G Nov 03 17:06:12 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:12 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.913s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:12 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:12 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Deleted volume successfully. Nov 03 17:06:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-badd7f83-cf3f-4a2c-a457-780772edab99 tempest-VolumesMetadataTest-510735757 None] Lock "cinder-1a1d47cc-2bb4-400e-b4e7-bf3f8cfef421-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:13 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc 1G" returned: 0 in 1.861s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:13 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc Nov 03 17:06:13 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Flow 'volume_create_manager' (2c71e430-b752-46c7-a889-1cca573918d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6badabe7-30de-45d9-aa1a-d380bb9f92ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6badabe7-30de-45d9-aa1a-d380bb9f92ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2027092384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ee5b6c-c721-4c5c-8cf5-92625647c78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc2f6d257047b795678b54d513426c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:14Z,use_quota=True,user_id='81ebbad828224c63bb6829b1145037a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe817ae-5857-4ab2-a11c-124301cb681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe817ae-5857-4ab2-a11c-124301cb681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eff616c-59f0-41a4-ace8-1079a16f54c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eff616c-59f0-41a4-ace8-1079a16f54c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ee5b6c-c721-4c5c-8cf5-92625647c78f', 'volume_name': 'volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c15ad8-6c38-40d3-a20d-e5109c2254bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c15ad8-6c38-40d3-a20d-e5109c2254bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e5b0c7-a7c0-4098-af54-8bfad3aa7e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Volume 98ee5b6c-c721-4c5c-8cf5-92625647c78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f', 'volume_size': 1} Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:14 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc" returned: 0 in 0.549s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:14 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc is being set with open permissions: ugo+rw Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:14 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc Nov 03 17:06:14 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:14 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc" returned: 0 in 0.517s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:15 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.info Nov 03 17:06:15 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:15 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.info" returned: 0 in 0.401s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:15 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.info is being set with open permissions: ugo+rw Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:15 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.info Nov 03 17:06:15 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:15 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.info" returned: 0 in 0.443s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.785s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2027092384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ee5b6c-c721-4c5c-8cf5-92625647c78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc2f6d257047b795678b54d513426c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:14Z,use_quota=True,user_id='81ebbad828224c63bb6829b1145037a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Creating volume 98ee5b6c-c721-4c5c-8cf5-92625647c78f {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:16 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:06:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:16 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f 1073741824 Nov 03 17:06:16 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-316524bd-b917-473d-b726-d24e993a4517 tempest-TestStampPattern-124371638 None] Create snapshot completed successfully Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (32d10ff1-c3ac-4bc3-ac4e-76362cb1c439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1049459b-af40-414e-9012-1e8749e551af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:17 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f 1073741824" returned: 0 in 1.072s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1049459b-af40-414e-9012-1e8749e551af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352729733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde58f5c-d89d-4980-8a18-c00960610c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:17Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53e6eaa-0370-4f03-b954-cb944e98e2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53e6eaa-0370-4f03-b954-cb944e98e2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c73838-2ee4-47a1-8718-b5f75a536b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c73838-2ee4-47a1-8718-b5f75a536b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde58f5c-d89d-4980-8a18-c00960610c34', 'volume_name': 'volume-cde58f5c-d89d-4980-8a18-c00960610c34', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5653d2-2606-4e49-8942-98dcee8f62f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5653d2-2606-4e49-8942-98dcee8f62f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8140cb2-63aa-4973-a912-fe40d0bb6cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Volume cde58f5c-d89d-4980-8a18-c00960610c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde58f5c-d89d-4980-8a18-c00960610c34', 'volume_size': 1} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:17 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f Nov 03 17:06:17 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:17 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f" returned: 0 in 0.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352729733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde58f5c-d89d-4980-8a18-c00960610c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:17Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Creating volume cde58f5c-d89d-4980-8a18-c00960610c34 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:17 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:17 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 1073741824 Nov 03 17:06:17 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e5b0c7-a7c0-4098-af54-8bfad3aa7e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6230f8ff-3153-4f94-9405-f683a60608d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Volume volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f (98ee5b6c-c721-4c5c-8cf5-92625647c78f): created successfully Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6230f8ff-3153-4f94-9405-f683a60608d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Flow 'volume_create_manager' (2c71e430-b752-46c7-a889-1cca573918d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b3d627c9-e20d-4f18-9eab-a70ae6716c4c tempest-TestMinimumBasicScenario-2065007776 None] Created volume successfully. Nov 03 17:06:18 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 1073741824" returned: 0 in 1.061s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:18 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 Nov 03 17:06:18 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:19 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34" returned: 0 in 0.647s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8140cb2-63aa-4973-a912-fe40d0bb6cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde58f5c-d89d-4980-8a18-c00960610c34', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aada3406-327e-4dc5-9895-7191e9759ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Volume volume-cde58f5c-d89d-4980-8a18-c00960610c34 (cde58f5c-d89d-4980-8a18-c00960610c34): created successfully Nov 03 17:06:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aada3406-327e-4dc5-9895-7191e9759ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (32d10ff1-c3ac-4bc3-ac4e-76362cb1c439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-22b130d0-4f9f-41e2-b963-47cb3cbafdd0 tempest-VolumesActionsTest-1241516873 None] Created volume successfully. Nov 03 17:06:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cbd1d0e-790a-463e-9bc9-5ccdbe5f694d tempest-VolumesActionsTest-1241516873 None] Acquiring lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34" by "attach_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cbd1d0e-790a-463e-9bc9-5ccdbe5f694d tempest-VolumesActionsTest-1241516873 None] Lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34" acquired by "attach_volume" :: waited 0.057s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1cbd1d0e-790a-463e-9bc9-5ccdbe5f694d tempest-VolumesActionsTest-1241516873 None] Attaching volume cde58f5c-d89d-4980-8a18-c00960610c34 to instance f794f310-1e19-4c29-a8dd-aa38a744c088 at mountpoint /dev/vdb on host None. Nov 03 17:06:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1cbd1d0e-790a-463e-9bc9-5ccdbe5f694d tempest-VolumesActionsTest-1241516873 None] Attach volume completed successfully. Nov 03 17:06:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cbd1d0e-790a-463e-9bc9-5ccdbe5f694d tempest-VolumesActionsTest-1241516873 None] Lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34" released by "attach_volume" :: held 0.270s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-acb476e9-e500-4871-9320-7b8ff476ac4d req-13237b0b-2502-4f40-b0c8-cbe4c6152171 tempest-TestMinimumBasicScenario-2065007776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-acb476e9-e500-4871-9320-7b8ff476ac4d req-13237b0b-2502-4f40-b0c8-cbe4c6152171 tempest-TestMinimumBasicScenario-2065007776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-acb476e9-e500-4871-9320-7b8ff476ac4d req-13237b0b-2502-4f40-b0c8-cbe4c6152171 tempest-TestMinimumBasicScenario-2065007776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-acb476e9-e500-4871-9320-7b8ff476ac4d req-13237b0b-2502-4f40-b0c8-cbe4c6152171 tempest-TestMinimumBasicScenario-2065007776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fc04b00-7b18-478f-ab3d-a8d516863129', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:06:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-acb476e9-e500-4871-9320-7b8ff476ac4d req-13237b0b-2502-4f40-b0c8-cbe4c6152171 tempest-TestMinimumBasicScenario-2065007776 None] attachment_update completed successfully. Nov 03 17:06:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-61b65e57-0424-43f6-8563-eb36543ab750 tempest-VolumesActionsTest-62144794 None] Terminate volume connection completed successfully. Nov 03 17:06:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61b65e57-0424-43f6-8563-eb36543ab750 tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-detach_volume" by "detach_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61b65e57-0424-43f6-8563-eb36543ab750 tempest-VolumesActionsTest-62144794 None] Lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-61b65e57-0424-43f6-8563-eb36543ab750 tempest-VolumesActionsTest-62144794 None] Detaching volume cde58f5c-d89d-4980-8a18-c00960610c34 from instance f794f310-1e19-4c29-a8dd-aa38a744c088. Nov 03 17:06:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-61b65e57-0424-43f6-8563-eb36543ab750 tempest-VolumesActionsTest-62144794 None] Detach volume completed successfully. Nov 03 17:06:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-61b65e57-0424-43f6-8563-eb36543ab750 tempest-VolumesActionsTest-62144794 None] Lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-detach_volume" released by "detach_volume" :: held 0.212s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-97ec1a3a-5e43-4ed3-9b09-dab96c4e6652 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-detach_volume" by "detach_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-97ec1a3a-5e43-4ed3-9b09-dab96c4e6652 tempest-VolumesActionsTest-1241516873 None] Lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-97ec1a3a-5e43-4ed3-9b09-dab96c4e6652 tempest-VolumesActionsTest-1241516873 None] Volume detach called, but volume not attached. Nov 03 17:06:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-97ec1a3a-5e43-4ed3-9b09-dab96c4e6652 tempest-VolumesActionsTest-1241516873 None] Lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Acquiring lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Acquiring lock "cinder-quobyte-cde58f5c-d89d-4980-8a18-c00960610c34" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Lock "cinder-quobyte-cde58f5c-d89d-4980-8a18-c00960610c34" acquired by "delete_volume" :: waited 0.043s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:24 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f291bcd1-1166-4e6b-bd9e-bdbf798a9ce2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:24 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 Nov 03 17:06:24 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:25 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34" returned: 0 in 1.140s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:25 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34 Nov 03 17:06:25 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:26 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cde58f5c-d89d-4980-8a18-c00960610c34" returned: 0 in 0.437s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Lock "cinder-quobyte-cde58f5c-d89d-4980-8a18-c00960610c34" released by "delete_volume" :: held 1.694s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Created reservations ['3bf12741-96b4-4cb6-9572-e6838e5f7353', 'c955a0c7-07db-49da-9772-0459915679b7', '594a97b0-be69-4582-9e5a-f9cf3645554a', '42e1174d-966c-46ed-9967-01794bf2b4b8'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:26 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:06:26 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:27 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.626s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:27 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Deleted volume successfully. Nov 03 17:06:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-de67da37-34aa-4218-8d20-34d2c3b1f87c tempest-VolumesActionsTest-1241516873 None] Lock "cinder-cde58f5c-d89d-4980-8a18-c00960610c34-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:29 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Flow 'volume_create_manager' (34a9e846-f976-4c44-a973-8a14c144639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2de5db-b103-4e37-a38f-8c9df6393f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2de5db-b103-4e37-a38f-8c9df6393f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1871420028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3819d0-b8d2-42de-b423-0bd73a428e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30595fb160da4abd9341e00ac3e22311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2dbf808e-d639-4404-819f-c270b2bf9ffc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:30Z,use_quota=True,user_id='5417ba3f955340d08766009e025f1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4d92c6-e64d-4de3-844e-18b35e0e7872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4d92c6-e64d-4de3-844e-18b35e0e7872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cddfb8-b2d8-4997-9bec-6326b5560961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cddfb8-b2d8-4997-9bec-6326b5560961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd3819d0-b8d2-42de-b423-0bd73a428e7a', 'volume_name': 'volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a', 'volume_size': 1, 'snapshot_id': '2dbf808e-d639-4404-819f-c270b2bf9ffc'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3172a8b-4e7a-426c-a4ce-477672a6160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3172a8b-4e7a-426c-a4ce-477672a6160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721bdb81-c777-4edd-a470-99c1fdf65997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:30 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Volume dd3819d0-b8d2-42de-b423-0bd73a428e7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a', 'volume_size': 1, 'snapshot_id': '2dbf808e-d639-4404-819f-c270b2bf9ffc'} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-quobyte-2dbf808e-d639-4404-819f-c270b2bf9ffc-dd3819d0-b8d2-42de-b423-0bd73a428e7a" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-2dbf808e-d639-4404-819f-c270b2bf9ffc-dd3819d0-b8d2-42de-b423-0bd73a428e7a" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Creating volume dd3819d0-b8d2-42de-b423-0bd73a428e7a from snapshot 2dbf808e-d639-4404-819f-c270b2bf9ffc {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-quobyte-dd3819d0-b8d2-42de-b423-0bd73a428e7a" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-dd3819d0-b8d2-42de-b423-0bd73a428e7a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] snapshot: 2dbf808e-d639-4404-819f-c270b2bf9ffc, volume: dd3819d0-b8d2-42de-b423-0bd73a428e7a, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3035b8-b1c9-471b-ab32-9cba99d89e3e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:30 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc Nov 03 17:06:30 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:30 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc" returned: 0 in 0.509s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5298c938-82a7-46d8-b029-fe512bd2238d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:30 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 Nov 03 17:06:30 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:30 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:06:30 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:31 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.522s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:31 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4" returned: 0 in 0.661s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:06:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:31 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a Nov 03 17:06:31 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (9ae65c71-8944-4d67-9171-6530723a0405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b367ed4-7f61-4367-be01-783276f84a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b367ed4-7f61-4367-be01-783276f84a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827360715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3926043d-42fe-41b0-85b4-bf65f3026fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:34Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d1978d-2708-40b3-91e7-c359c952f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d1978d-2708-40b3-91e7-c359c952f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcf13b7-57ab-4379-b118-50326c1f1b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcf13b7-57ab-4379-b118-50326c1f1b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3926043d-42fe-41b0-85b4-bf65f3026fd1', 'volume_name': 'volume-3926043d-42fe-41b0-85b4-bf65f3026fd1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfca9e02-bfbf-4de1-a00f-7a93ebcb8155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfca9e02-bfbf-4de1-a00f-7a93ebcb8155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae1a201-d286-4242-a723-da1dd0530580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:34 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Volume 3926043d-42fe-41b0-85b4-bf65f3026fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3926043d-42fe-41b0-85b4-bf65f3026fd1', 'volume_size': 1} Nov 03 17:06:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a" returned: 0 in 9.971s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4, size 1024.00 MB, duration 9.97 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:06:41 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Converted 1024.00 MB image at 102.68 MB/s Nov 03 17:06:41 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a is being set with open permissions: ugo+rw Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:41 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a Nov 03 17:06:41 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:41 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a" returned: 0 in 0.403s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-dd3819d0-b8d2-42de-b423-0bd73a428e7a" released by "_copy_volume_from_snapshot" :: held 11.690s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-2dbf808e-d639-4404-819f-c270b2bf9ffc-dd3819d0-b8d2-42de-b423-0bd73a428e7a" released by "_create_volume_from_snapshot" :: held 11.806s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.847s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.168s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827360715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3926043d-42fe-41b0-85b4-bf65f3026fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:34Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Creating volume 3926043d-42fe-41b0-85b4-bf65f3026fd1 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:41 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:06:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:41 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 1073741824 Nov 03 17:06:41 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721bdb81-c777-4edd-a470-99c1fdf65997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a', 'volume_size': 1, 'snapshot_id': '2dbf808e-d639-4404-819f-c270b2bf9ffc'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e5c534-d804-4dbc-8926-4e662dd978e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:42 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Volume volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a (dd3819d0-b8d2-42de-b423-0bd73a428e7a): created successfully Nov 03 17:06:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e5c534-d804-4dbc-8926-4e662dd978e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Flow 'volume_create_manager' (34a9e846-f976-4c44-a973-8a14c144639f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6380f0a0-8699-4e99-976e-815063badc41 tempest-TestStampPattern-124371638 None] Created volume successfully. Nov 03 17:06:42 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 1073741824" returned: 0 in 0.812s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:42 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 Nov 03 17:06:42 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:43 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1" returned: 0 in 0.461s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae1a201-d286-4242-a723-da1dd0530580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3926043d-42fe-41b0-85b4-bf65f3026fd1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5741e7-b1e3-4db8-af98-fc0325f923bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:43 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Volume volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 (3926043d-42fe-41b0-85b4-bf65f3026fd1): created successfully Nov 03 17:06:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5741e7-b1e3-4db8-af98-fc0325f923bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (9ae65c71-8944-4d67-9171-6530723a0405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:43 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cc87058d-2036-4cbf-bd2e-17dafd56ab37 tempest-VolumesActionsTest-1241516873 None] Created volume successfully. Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Flow 'volume_create_manager' (40c1b633-90c2-4650-ad3f-0567e0965199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d34be88-fcf8-4f9d-91a1-a1646639fac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d34be88-fcf8-4f9d-91a1-a1646639fac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-407523983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb782efd-00fa-42fb-913c-f9c8b5b7e127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c5a13d85974148b0bda5f0d9b0f157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:44Z,use_quota=True,user_id='0654fce00ce744fdb68009cceaef2c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c2b77e-b9bc-4366-9f84-97cabf31a2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c2b77e-b9bc-4366-9f84-97cabf31a2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70984342-ecdb-4421-a13b-80f4bfd75f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70984342-ecdb-4421-a13b-80f4bfd75f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb782efd-00fa-42fb-913c-f9c8b5b7e127', 'volume_name': 'volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c01784f-6ad8-417c-af8b-a9529b695571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c01784f-6ad8-417c-af8b-a9529b695571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00925e01-0249-48f0-a455-82356e731ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Volume eb782efd-00fa-42fb-913c-f9c8b5b7e127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127', 'volume_size': 1} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-407523983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb782efd-00fa-42fb-913c-f9c8b5b7e127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c5a13d85974148b0bda5f0d9b0f157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:44Z,use_quota=True,user_id='0654fce00ce744fdb68009cceaef2c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Creating volume eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:44 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:44 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 1073741824 Nov 03 17:06:44 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-3926043d-42fe-41b0-85b4-bf65f3026fd1-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Lock "cinder-3926043d-42fe-41b0-85b4-bf65f3026fd1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-quobyte-3926043d-42fe-41b0-85b4-bf65f3026fd1" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Lock "cinder-quobyte-3926043d-42fe-41b0-85b4-bf65f3026fd1" acquired by "delete_volume" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:45 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 1073741824" returned: 0 in 0.702s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd018dc-e908-46df-8517-d434bfc13a81]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:45 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:06:45 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:45 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 Nov 03 17:06:45 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:45 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.353s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00925e01-0249-48f0-a455-82356e731ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4366fad7-5ac3-4711-9c0e-602653152398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:45 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Volume volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 (eb782efd-00fa-42fb-913c-f9c8b5b7e127): created successfully Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4366fad7-5ac3-4711-9c0e-602653152398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Flow 'volume_create_manager' (40c1b633-90c2-4650-ad3f-0567e0965199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f3534872-c0d0-4efd-835c-6cba82036f53 tempest-VolumesActionsTest-2007755646 None] Created volume successfully. Nov 03 17:06:45 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1" returned: 0 in 0.622s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:45 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1 Nov 03 17:06:45 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:46 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3926043d-42fe-41b0-85b4-bf65f3026fd1" returned: 0 in 0.415s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Lock "cinder-quobyte-3926043d-42fe-41b0-85b4-bf65f3026fd1" released by "delete_volume" :: held 1.115s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Created reservations ['e4c3ff58-57c6-431b-830e-fb2a22a3a3bc', '792a4947-3d44-469e-8c15-55c2f4b44e35', '46a28587-a202-498d-a8ac-baa9fcba1579', '853b7e6a-505e-49a5-8a1a-082ede674a0a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:46 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:06:46 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:46 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.365s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Deleted volume successfully. Nov 03 17:06:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-20dba301-7cd6-49d8-b949-113054bc22be tempest-VolumesActionsTest-62144794 None] Lock "cinder-3926043d-42fe-41b0-85b4-bf65f3026fd1-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (27b18843-5e72-4c6f-af42-1d7f95fdff27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a00257-419d-479f-8e5f-2989bac15a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a00257-419d-479f-8e5f-2989bac15a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-149099024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6528edf7-83fd-4b50-8c45-15bea4167123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:48Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5281e16-acde-4915-b446-2bbaa41ee50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5281e16-acde-4915-b446-2bbaa41ee50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cd9f5f-c892-425c-8d80-584bfa206411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cd9f5f-c892-425c-8d80-584bfa206411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6528edf7-83fd-4b50-8c45-15bea4167123', 'volume_name': 'volume-6528edf7-83fd-4b50-8c45-15bea4167123', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0945d99-178d-49b5-a0e8-4ec08d961355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0945d99-178d-49b5-a0e8-4ec08d961355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a37f919-7551-4397-a031-61b2f8dbb2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:48 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Volume 6528edf7-83fd-4b50-8c45-15bea4167123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6528edf7-83fd-4b50-8c45-15bea4167123', 'volume_size': 1} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-149099024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6528edf7-83fd-4b50-8c45-15bea4167123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:48Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Creating volume 6528edf7-83fd-4b50-8c45-15bea4167123 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:48 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:06:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:48 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 1073741824 Nov 03 17:06:48 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:49 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 1073741824" returned: 0 in 1.140s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:50 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 Nov 03 17:06:50 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:50 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123" returned: 0 in 0.597s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a37f919-7551-4397-a031-61b2f8dbb2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6528edf7-83fd-4b50-8c45-15bea4167123', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafa961a-bd60-4b0c-8cb3-77fa5fa87b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:50 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Volume volume-6528edf7-83fd-4b50-8c45-15bea4167123 (6528edf7-83fd-4b50-8c45-15bea4167123): created successfully Nov 03 17:06:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafa961a-bd60-4b0c-8cb3-77fa5fa87b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:50 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (27b18843-5e72-4c6f-af42-1d7f95fdff27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:50 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a3845a29-1767-49a5-9bfd-3afca4c7657c tempest-VolumesActionsTest-1241516873 None] Created volume successfully. Nov 03 17:06:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-6528edf7-83fd-4b50-8c45-15bea4167123-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Lock "cinder-6528edf7-83fd-4b50-8c45-15bea4167123-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-quobyte-6528edf7-83fd-4b50-8c45-15bea4167123" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Lock "cinder-quobyte-6528edf7-83fd-4b50-8c45-15bea4167123" acquired by "delete_volume" :: waited 0.048s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:52 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0253b8b-38e1-4e5b-8645-f5bf2600f713]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:53 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 Nov 03 17:06:53 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:53 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123" returned: 0 in 0.787s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:53 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123 Nov 03 17:06:53 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:54 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6528edf7-83fd-4b50-8c45-15bea4167123" returned: 0 in 0.538s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Lock "cinder-quobyte-6528edf7-83fd-4b50-8c45-15bea4167123" released by "delete_volume" :: held 1.427s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Created reservations ['4e25a860-0790-4ee1-bf9b-98f81d655928', '381377d4-618a-4e63-a1a5-38561689a8c9', '98cfa77b-b3ab-424f-9aa5-fa13183e1228', '3b5f09b8-e151-4381-bf63-0e46f2d13579'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:54 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:06:54 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:54 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.320s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Deleted volume successfully. Nov 03 17:06:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-10bcf0e4-80d2-42d3-a795-c7bd10c22a48 tempest-VolumesActionsTest-62144794 None] Lock "cinder-6528edf7-83fd-4b50-8c45-15bea4167123-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (75cc505c-9fe4-4165-8e5a-dfc01779a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44002b1-b61c-4840-8716-282c9d56b71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44002b1-b61c-4840-8716-282c9d56b71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1085710455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:56Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45057a57-abca-4e72-8e23-1ccdf2da7c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45057a57-abca-4e72-8e23-1ccdf2da7c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7ef43f-174e-4a78-99bb-960fd746b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7ef43f-174e-4a78-99bb-960fd746b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f', 'volume_name': 'volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7487f8e4-5d72-4982-b336-759acea907f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7487f8e4-5d72-4982-b336-759acea907f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac93117-03a6-4a35-b0cf-94dc7100654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Volume 64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f', 'volume_size': 1} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1085710455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:56Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Creating volume 64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:55 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:06:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:55 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f 1073741824 Nov 03 17:06:55 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:56 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f 1073741824" returned: 0 in 0.925s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:57 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f Nov 03 17:06:57 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:57 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f" returned: 0 in 0.562s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac93117-03a6-4a35-b0cf-94dc7100654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b5240-ef0c-41a4-b558-b55bf3fe54f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:57 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Volume volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f (64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f): created successfully Nov 03 17:06:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b5240-ef0c-41a4-b558-b55bf3fe54f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (75cc505c-9fe4-4165-8e5a-dfc01779a75d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4d770f32-de4e-4d4e-9d30-87a5cf8ff87d tempest-VolumesActionsTest-1241516873 None] Created volume successfully. Nov 03 17:06:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Lock "cinder-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-quobyte-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Lock "cinder-quobyte-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:58 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc9e839-45fa-417d-83d8-89918c2ca18b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:59 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f Nov 03 17:06:59 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:59 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f" returned: 0 in 0.734s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:59 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f Nov 03 17:06:59 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:59 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f" returned: 0 in 0.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Lock "cinder-quobyte-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f" released by "delete_volume" :: held 1.154s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Created reservations ['1d6a334d-3ad0-4629-9797-87f1331e7cf7', '789ba816-d105-4cad-8e9c-990f94e21c99', 'b7344509-1863-461c-8aac-d9ee6a6a6ed3', '5ba079ca-f9c1-4487-9c0a-ce0b85f3927b'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:00 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:07:00 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:00 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.470s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Deleted volume successfully. Nov 03 17:07:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-764166f2-e137-46a8-96ef-4629f422a270 tempest-VolumesActionsTest-62144794 None] Lock "cinder-64ff01b4-ca39-4a1b-9769-aaef2ceb6a1f-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ca10025a-c287-48a5-a244-11c935cb948f tempest-VolumesActionsTest-2007755646 None] Acquiring lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127" by "attach_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ca10025a-c287-48a5-a244-11c935cb948f tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127" acquired by "attach_volume" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ca10025a-c287-48a5-a244-11c935cb948f tempest-VolumesActionsTest-2007755646 None] Attaching volume eb782efd-00fa-42fb-913c-f9c8b5b7e127 to instance 417e14f7-75b5-42be-828a-bafcc3571b85 at mountpoint /dev/vdb on host None. Nov 03 17:07:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ca10025a-c287-48a5-a244-11c935cb948f tempest-VolumesActionsTest-2007755646 None] Attach volume completed successfully. Nov 03 17:07:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ca10025a-c287-48a5-a244-11c935cb948f tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127" released by "attach_volume" :: held 0.154s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-726a8503-9960-443e-9043-9377f21c4222 tempest-VolumesActionsTest-2007755646 None] Acquiring lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-detach_volume" by "detach_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-726a8503-9960-443e-9043-9377f21c4222 tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-726a8503-9960-443e-9043-9377f21c4222 tempest-VolumesActionsTest-2007755646 None] Detaching volume eb782efd-00fa-42fb-913c-f9c8b5b7e127 from instance 417e14f7-75b5-42be-828a-bafcc3571b85. Nov 03 17:07:02 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-726a8503-9960-443e-9043-9377f21c4222 tempest-VolumesActionsTest-2007755646 None] Detach volume completed successfully. Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-726a8503-9960-443e-9043-9377f21c4222 tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (0cd65456-ddd8-40ca-ad92-01369cd01e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be91a08f-b526-4eb3-b207-09e9b96d9c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be91a08f-b526-4eb3-b207-09e9b96d9c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-69902692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ac41da-068c-4600-ae89-defce83a50c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:02Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abf19e8-76ff-465d-a0f3-78466edb14d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abf19e8-76ff-465d-a0f3-78466edb14d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5d79c6-26d7-4b31-a00c-f771985c8c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5d79c6-26d7-4b31-a00c-f771985c8c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ac41da-068c-4600-ae89-defce83a50c8', 'volume_name': 'volume-f5ac41da-068c-4600-ae89-defce83a50c8', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd82985a-d3ce-47b6-bc8e-197c39af3c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd82985a-d3ce-47b6-bc8e-197c39af3c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60174073-dc3f-4390-b044-99113e9b6f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:02 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Volume f5ac41da-068c-4600-ae89-defce83a50c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ac41da-068c-4600-ae89-defce83a50c8', 'volume_size': 1} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-69902692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ac41da-068c-4600-ae89-defce83a50c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:02Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Creating volume f5ac41da-068c-4600-ae89-defce83a50c8 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:02 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:07:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:02 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 1073741824 Nov 03 17:07:02 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:03 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 1073741824" returned: 0 in 1.156s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:03 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 Nov 03 17:07:03 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:04 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60174073-dc3f-4390-b044-99113e9b6f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ac41da-068c-4600-ae89-defce83a50c8', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbd44b6-56c0-48e2-bb85-15ea554d6643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:04 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Volume volume-f5ac41da-068c-4600-ae89-defce83a50c8 (f5ac41da-068c-4600-ae89-defce83a50c8): created successfully Nov 03 17:07:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbd44b6-56c0-48e2-bb85-15ea554d6643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (0cd65456-ddd8-40ca-ad92-01369cd01e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:04 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8cabf999-31e6-43bc-a752-1fa466122c4b tempest-VolumesActionsTest-1241516873 None] Created volume successfully. Nov 03 17:07:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-f5ac41da-068c-4600-ae89-defce83a50c8-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Lock "cinder-f5ac41da-068c-4600-ae89-defce83a50c8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Acquiring lock "cinder-quobyte-f5ac41da-068c-4600-ae89-defce83a50c8" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Lock "cinder-quobyte-f5ac41da-068c-4600-ae89-defce83a50c8" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:05 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[612406e7-8f49-45c5-bc6c-85e68fe7fadc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:05 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 Nov 03 17:07:05 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:06 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8" returned: 0 in 0.485s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:06 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8 Nov 03 17:07:06 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:06 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5ac41da-068c-4600-ae89-defce83a50c8" returned: 0 in 0.307s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Lock "cinder-quobyte-f5ac41da-068c-4600-ae89-defce83a50c8" released by "delete_volume" :: held 0.889s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Created reservations ['2ce68cf2-51cf-4b20-9cd8-6f7d207ffad7', 'a750fd3c-e5cd-4b21-b164-faea15a1dc83', 'b72e4049-6204-4341-8c7c-85ac48576f78', '2c4e4963-1721-4f09-9330-bbaeb8cb3d9c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:06 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:07:06 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:07 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.297s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:07 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Deleted volume successfully. Nov 03 17:07:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7e655e18-8c57-4d39-8414-cb46aaf52d58 tempest-VolumesActionsTest-62144794 None] Lock "cinder-f5ac41da-068c-4600-ae89-defce83a50c8-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (5db972b5-38f8-45d6-b55c-3ce1c2083e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca0af20-e26c-4015-8a1c-340049809072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca0af20-e26c-4015-8a1c-340049809072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1505488667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfe42e2-10e3-461e-83c7-6d7d8515e542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:09Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48688ad-a057-412d-8d80-b0e25b594cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48688ad-a057-412d-8d80-b0e25b594cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e091920-4357-4fef-8123-685eded48011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e091920-4357-4fef-8123-685eded48011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bfe42e2-10e3-461e-83c7-6d7d8515e542', 'volume_name': 'volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fe5a9c-bfe4-4281-9de6-d319c95a7f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fe5a9c-bfe4-4281-9de6-d319c95a7f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4977bf06-69b4-41a4-8fe8-bb9841c17322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:09 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Volume 6bfe42e2-10e3-461e-83c7-6d7d8515e542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542', 'volume_size': 1} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1505488667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfe42e2-10e3-461e-83c7-6d7d8515e542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d4ec6dc474242a310c308f03f0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:09Z,use_quota=True,user_id='8a39bd0b2c374a0089aa8197be2d2223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Creating volume 6bfe42e2-10e3-461e-83c7-6d7d8515e542 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:09 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:09 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 1073741824 Nov 03 17:07:09 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:09 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 1073741824" returned: 0 in 0.770s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=79,cinder:INSERT=20,cinder:UPDATE=83,cinder:DELETE=9 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=68,cinder:UPDATE=81,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:07:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:09 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 Nov 03 17:07:09 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:10 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542" returned: 0 in 0.344s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4977bf06-69b4-41a4-8fe8-bb9841c17322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23aaa92d-b0b3-428e-91a6-2a8ff1f44355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Volume volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 (6bfe42e2-10e3-461e-83c7-6d7d8515e542): created successfully Nov 03 17:07:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23aaa92d-b0b3-428e-91a6-2a8ff1f44355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Flow 'volume_create_manager' (5db972b5-38f8-45d6-b55c-3ce1c2083e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:10 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a6efd53b-339e-4713-a050-ac8c7528b207 tempest-VolumesActionsTest-1241516873 None] Created volume successfully. Nov 03 17:07:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "cinder-6bfe42e2-10e3-461e-83c7-6d7d8515e542-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Lock "cinder-6bfe42e2-10e3-461e-83c7-6d7d8515e542-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "cinder-quobyte-6bfe42e2-10e3-461e-83c7-6d7d8515e542" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Lock "cinder-quobyte-6bfe42e2-10e3-461e-83c7-6d7d8515e542" acquired by "delete_volume" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7a19a0-e20a-4949-8966-d96b742b5b5b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:12 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 Nov 03 17:07:12 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:13 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542" returned: 0 in 0.772s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:13 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542 Nov 03 17:07:13 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:13 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6bfe42e2-10e3-461e-83c7-6d7d8515e542" returned: 0 in 0.359s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Lock "cinder-quobyte-6bfe42e2-10e3-461e-83c7-6d7d8515e542" released by "delete_volume" :: held 1.232s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Created reservations ['611e546f-a294-4996-a246-f1d5980d8f58', '078a42c0-8e72-4be8-a4fa-3ad17bfb5315', 'ed46d02f-c099-44a9-a3f8-a9769168c18d', '5c97f28e-350a-4a17-80b2-fd609d67b401'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:13 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:07:13 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:13 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.391s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:14 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:14 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Deleted volume successfully. Nov 03 17:07:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-45e83c60-b3ff-4607-8b56-9257c23a4744 tempest-VolumesActionsTest-1241516873 None] Lock "cinder-6bfe42e2-10e3-461e-83c7-6d7d8515e542-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-41e83f36-07b8-4835-a653-ef61837139be tempest-VolumesActionsTest-2007755646 None] Acquiring lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127" by "attach_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-41e83f36-07b8-4835-a653-ef61837139be tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127" acquired by "attach_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-41e83f36-07b8-4835-a653-ef61837139be tempest-VolumesActionsTest-2007755646 None] Attaching volume eb782efd-00fa-42fb-913c-f9c8b5b7e127 to instance 5c883b7c-7618-49dd-b31d-1ccd16903b97 at mountpoint /dev/vdb on host None. Nov 03 17:07:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-41e83f36-07b8-4835-a653-ef61837139be tempest-VolumesActionsTest-2007755646 None] Attach volume completed successfully. Nov 03 17:07:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-41e83f36-07b8-4835-a653-ef61837139be tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127" released by "attach_volume" :: held 0.180s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d6ef973c-b99f-4481-9f71-936303d02ff8 tempest-VolumesActionsTest-2007755646 None] Acquiring lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-detach_volume" by "detach_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d6ef973c-b99f-4481-9f71-936303d02ff8 tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d6ef973c-b99f-4481-9f71-936303d02ff8 tempest-VolumesActionsTest-2007755646 None] Detaching volume eb782efd-00fa-42fb-913c-f9c8b5b7e127 from instance 5c883b7c-7618-49dd-b31d-1ccd16903b97. Nov 03 17:07:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d6ef973c-b99f-4481-9f71-936303d02ff8 tempest-VolumesActionsTest-2007755646 None] Detach volume completed successfully. Nov 03 17:07:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d6ef973c-b99f-4481-9f71-936303d02ff8 tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-detach_volume" released by "detach_volume" :: held 0.165s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-32a95b76-e4b8-4e2f-997d-57fec7893f8e req-66d1bd31-63f5-48cb-8ff1-2dc2319a92e2 tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-32a95b76-e4b8-4e2f-997d-57fec7893f8e req-66d1bd31-63f5-48cb-8ff1-2dc2319a92e2 tempest-TestStampPattern-124371638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-32a95b76-e4b8-4e2f-997d-57fec7893f8e req-66d1bd31-63f5-48cb-8ff1-2dc2319a92e2 tempest-TestStampPattern-124371638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-32a95b76-e4b8-4e2f-997d-57fec7893f8e req-66d1bd31-63f5-48cb-8ff1-2dc2319a92e2 tempest-TestStampPattern-124371638 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85bc04b9-7f76-4f71-84c6-6cdeb97a1699', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:07:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-32a95b76-e4b8-4e2f-997d-57fec7893f8e req-66d1bd31-63f5-48cb-8ff1-2dc2319a92e2 tempest-TestStampPattern-124371638 None] attachment_update completed successfully. Nov 03 17:07:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde2f1f9-6515-4d5c-aaf1-e10ad52f772a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:22 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:07:22 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:22 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.469s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bcafa7-53fa-4110-ab54-af2d025c7479]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:22 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:07:22 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:23 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.477s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.4bf33fe6-aa99-489b-88d5-e5669bf21379r9it_xzg.img {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:23 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.4bf33fe6-aa99-489b-88d5-e5669bf21379r9it_xzg.img Nov 03 17:07:23 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-51d8370e-eb79-4b22-9a57-d3295556d905 req-71812107-464c-44e1-8e2a-2d0b67e6d269 tempest-TestStampPattern-124371638 None] Terminate volume connection completed successfully. Nov 03 17:07:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-51d8370e-eb79-4b22-9a57-d3295556d905 req-71812107-464c-44e1-8e2a-2d0b67e6d269 tempest-TestStampPattern-124371638 None] Deleting attachment 85bc04b9-7f76-4f71-84c6-6cdeb97a1699. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:07:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:07:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:30 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:07:30 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:31 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.606s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:07:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:07:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:07:32 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-dd3819d0-b8d2-42de-b423-0bd73a428e7a-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.4bf33fe6-aa99-489b-88d5-e5669bf21379r9it_xzg.img" returned: 0 in 9.839s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Lock "cinder-dd3819d0-b8d2-42de-b423-0bd73a428e7a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:32 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74a53e8-3d3d-4e27-bc41-4620294c6f26]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-quobyte-dd3819d0-b8d2-42de-b423-0bd73a428e7a" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-dd3819d0-b8d2-42de-b423-0bd73a428e7a" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7089b9c-84e6-4d0f-aab3-8bdc87eae836]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:33 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:07:33 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:33 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a Nov 03 17:07:33 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:33 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a" returned: 0 in 0.529s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:33 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a Nov 03 17:07:33 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:33 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.905s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127, size 1024.00 MB, duration 9.84 sec, destination /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.4bf33fe6-aa99-489b-88d5-e5669bf21379r9it_xzg.img {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:07:33 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Converted 1024.00 MB image at 104.06 MB/s Nov 03 17:07:33 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] 4bf33fe6-aa99-489b-88d5-e5669bf21379 was raw, no need to convert to raw {{(pid=86939) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 17:07:34 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-dd3819d0-b8d2-42de-b423-0bd73a428e7a" returned: 0 in 0.392s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-dd3819d0-b8d2-42de-b423-0bd73a428e7a" released by "delete_volume" :: held 1.012s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Created reservations ['fd5ad4a3-75f6-4695-9617-4f5a0abfb26a', '0a7648b0-050f-41f5-8c18-91857671ccd5', 'de76edb1-59f6-4823-9d10-4db6ba284c94', 'f44b5395-a095-4c28-a627-60e68cb1f16e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:34 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:07:34 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:34 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.371s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Deleted volume successfully. Nov 03 17:07:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7f1ac032-06c2-4cab-8dec-3f7e0682dd68 tempest-TestStampPattern-124371638 None] Lock "cinder-dd3819d0-b8d2-42de-b423-0bd73a428e7a-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:35 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-acebb7e0-fdb0-4b43-85b4-c632cf7dafdf req-41ca0730-d358-4959-99a1-3ad7d96c1dfb tempest-TestMinimumBasicScenario-2065007776 None] Terminate volume connection completed successfully. Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-acebb7e0-fdb0-4b43-85b4-c632cf7dafdf req-41ca0730-d358-4959-99a1-3ad7d96c1dfb tempest-TestMinimumBasicScenario-2065007776 None] Deleting attachment 7fc04b00-7b18-478f-ab3d-a8d516863129. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-2dbf808e-d639-4404-819f-c270b2bf9ffc-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Lock "cinder-2dbf808e-d639-4404-819f-c270b2bf9ffc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-quobyte-f6a6b353-f579-4b95-a180-9d8d78eabcf4" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-f6a6b353-f579-4b95-a180-9d8d78eabcf4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-quobyte-2dbf808e-d639-4404-819f-c270b2bf9ffc" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-2dbf808e-d639-4404-819f-c270b2bf9ffc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Deleting offline snapshot 2dbf808e-d639-4404-819f-c270b2bf9ffc of volume f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] snapshot_file for this snap is: volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bae595-18b0-46d8-9558-ef5ee66a2ce2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:35 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc Nov 03 17:07:35 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:36 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc" returned: 0 in 0.561s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5c55b6-ddff-4047-abd1-60262cf06298]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Acquiring lock "cinder-98ee5b6c-c721-4c5c-8cf5-92625647c78f-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Lock "cinder-98ee5b6c-c721-4c5c-8cf5-92625647c78f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:36 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 Nov 03 17:07:36 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Acquiring lock "cinder-quobyte-98ee5b6c-c721-4c5c-8cf5-92625647c78f" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Lock "cinder-quobyte-98ee5b6c-c721-4c5c-8cf5-92625647c78f" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[af19d337-a362-4f57-a0c4-6751224017fe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:36 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f Nov 03 17:07:36 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:37 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f" returned: 0 in 0.478s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:37 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4" returned: 0 in 0.851s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:37 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f Nov 03 17:07:37 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:37 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc Nov 03 17:07:37 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:37 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-98ee5b6c-c721-4c5c-8cf5-92625647c78f" returned: 0 in 0.549s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Lock "cinder-quobyte-98ee5b6c-c721-4c5c-8cf5-92625647c78f" released by "delete_volume" :: held 1.114s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:37 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc" returned: 0 in 0.586s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:37 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc Nov 03 17:07:37 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:37 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Created reservations ['f7a47d38-606c-43d7-9752-23a792b0dd09', 'c5750c0e-2ee5-4a3b-ab27-b9d18cf4ad72', 'd2532937-6fe2-44a7-8fa0-5b31fa5b80aa', '859a0b33-30da-40d5-8ad3-1b8e5e552116'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:38 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:07:38 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:38 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4.2dbf808e-d639-4404-819f-c270b2bf9ffc" returned: 0 in 0.391s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-2dbf808e-d639-4404-819f-c270b2bf9ffc" released by "_delete_snapshot" :: held 2.632s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-f6a6b353-f579-4b95-a180-9d8d78eabcf4" released by "delete_snapshot" :: held 2.671s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Created reservations ['165b97ec-e46c-485c-a910-128c11a04270', '68562cf2-a5e2-4ffa-8495-d77c971b1a6d', 'b1feecde-0374-4ab5-9c9f-170c05dae8c9', '336e2dff-6b13-4a62-96a7-2bca3b0fd4b0'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:38 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.433s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Deleted volume successfully. Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2c803087-6c27-4851-b9c3-7f68f591c792 tempest-TestMinimumBasicScenario-2065007776 None] Lock "cinder-98ee5b6c-c721-4c5c-8cf5-92625647c78f-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Delete snapshot completed successfully. Nov 03 17:07:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64e0355a-e267-4cdf-aebc-b3250c18cf0f tempest-TestStampPattern-124371638 None] Lock "cinder-2dbf808e-d639-4404-819f-c270b2bf9ffc-delete_snapshot" released by "delete_snapshot" :: held 2.910s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Flow 'volume_create_manager' (8a7d68af-d7f8-45a0-8704-2939a8e2e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e14f080-88ff-4dfa-b1f7-6a575cbcf1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e14f080-88ff-4dfa-b1f7-6a575cbcf1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-998647067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77cf9c7-7521-4548-b617-86897b655360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='984feed7fdc94608a0292bee8dd6929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:40Z,use_quota=True,user_id='ab9ac072ea8d4a6384f60ebc54818bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dfca47-7a93-4c86-ab1b-6698505fa339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dfca47-7a93-4c86-ab1b-6698505fa339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffef679b-9939-4c3d-8815-af47fbcf4fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffef679b-9939-4c3d-8815-af47fbcf4fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77cf9c7-7521-4548-b617-86897b655360', 'volume_name': 'volume-e77cf9c7-7521-4548-b617-86897b655360', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235d2a90-489c-4183-92f5-b6799bb14e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235d2a90-489c-4183-92f5-b6799bb14e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103500ed-eb7e-4f0d-8031-b1ecc41024ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:40 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Volume e77cf9c7-7521-4548-b617-86897b655360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77cf9c7-7521-4548-b617-86897b655360', 'volume_size': 1} Nov 03 17:07:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-f6a6b353-f579-4b95-a180-9d8d78eabcf4-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Lock "cinder-f6a6b353-f579-4b95-a180-9d8d78eabcf4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Acquiring lock "cinder-quobyte-f6a6b353-f579-4b95-a180-9d8d78eabcf4" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-f6a6b353-f579-4b95-a180-9d8d78eabcf4" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5f6eca-6980-4d4d-910c-260d662efcde]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:44 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 Nov 03 17:07:44 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:45 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4" returned: 0 in 0.481s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:45 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4 Nov 03 17:07:45 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:45 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f6a6b353-f579-4b95-a180-9d8d78eabcf4" returned: 0 in 0.340s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Lock "cinder-quobyte-f6a6b353-f579-4b95-a180-9d8d78eabcf4" released by "delete_volume" :: held 0.959s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Created reservations ['de9a3b68-b399-4fda-8882-616cd2aa40ed', 'c31ca1cc-9d97-43d1-91c1-4fbd7f7db2ad', 'e0a13f20-eac4-4d1a-849a-ad8dab8be5ce', '3233b0a1-fa4d-47fb-ad54-351dd3280883'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:45 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:07:45 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:45 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.316s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:45 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Deleted volume successfully. Nov 03 17:07:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5bcbac09-8436-4e01-b13b-c9397febc4e9 tempest-TestStampPattern-124371638 None] Lock "cinder-f6a6b353-f579-4b95-a180-9d8d78eabcf4-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:55 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=44,cinder:DELETE=4,cinder:SELECT=47,cinder:INSERT=10 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:07:55 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=41,cinder:INSERT=13,cinder:UPDATE=46,cinder:DELETE=1 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.950s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Uploaded volume to glance image-id: 4bf33fe6-aa99-489b-88d5-e5669bf21379. {{(pid=86939) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.933s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-998647067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77cf9c7-7521-4548-b617-86897b655360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='984feed7fdc94608a0292bee8dd6929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:40Z,use_quota=True,user_id='ab9ac072ea8d4a6384f60ebc54818bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Creating volume e77cf9c7-7521-4548-b617-86897b655360 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:01 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-da8585c3-9d78-44f1-a882-5709a459114b tempest-VolumesActionsTest-2007755646 None] Copy volume to image completed successfully. Nov 03 17:08:01 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 1073741824 Nov 03 17:08:01 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:01 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 1073741824" returned: 0 in 0.614s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:01 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 Nov 03 17:08:01 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:02 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360" returned: 0 in 0.292s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103500ed-eb7e-4f0d-8031-b1ecc41024ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77cf9c7-7521-4548-b617-86897b655360', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ffb180-e72b-4b84-83ff-8f899b57f3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:02 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Volume volume-e77cf9c7-7521-4548-b617-86897b655360 (e77cf9c7-7521-4548-b617-86897b655360): created successfully Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ffb180-e72b-4b84-83ff-8f899b57f3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Flow 'volume_create_manager' (8a7d68af-d7f8-45a0-8704-2939a8e2e046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:02 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-75c75b5d-c410-48cd-bdee-dc7fd2c3c65c tempest-VolumesListAdminTestJSON-515041771 None] Created volume successfully. Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[886e21be-5283-43d3-9d6f-c518942c5cb3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:02 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:08:02 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (22fd65f8-aac7-4d8b-97ba-a378c9e08ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01e51b7-3954-4ecf-a82f-632e024270dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.600s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01e51b7-3954-4ecf-a82f-632e024270dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1204677917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2a59a5-7545-42b5-b9d8-f552cf78fcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:03Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1982811-9e79-42f8-833e-3c422c7d97fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1982811-9e79-42f8-833e-3c422c7d97fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7568349f-111e-44f3-962a-32a203549433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7568349f-111e-44f3-962a-32a203549433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2a59a5-7545-42b5-b9d8-f552cf78fcac', 'volume_name': 'volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b82f762-170a-4f7e-bca3-0ba0ac78b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b82f762-170a-4f7e-bca3-0ba0ac78b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1878385-0d10-44b5-bca9-7a6872756173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume 7b2a59a5-7545-42b5-b9d8-f552cf78fcac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac', 'volume_size': 1} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a397b63-6f7c-4edb-b907-2dfee88f9cee]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:03 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:08:03 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Flow 'volume_create_manager' (313e0a4f-b007-4cd2-a0fd-ddf10c813f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7369dc-b646-4f80-9cc2-fc0368ed63fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7369dc-b646-4f80-9cc2-fc0368ed63fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1047466931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b78c558-72c7-4ae4-ae68-75472b1e6f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='984feed7fdc94608a0292bee8dd6929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:04Z,use_quota=True,user_id='ab9ac072ea8d4a6384f60ebc54818bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9487e207-a1c2-4864-9a07-c5558c356c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9487e207-a1c2-4864-9a07-c5558c356c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798de592-7724-419a-ab4d-6ac35cb10144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798de592-7724-419a-ab4d-6ac35cb10144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b78c558-72c7-4ae4-ae68-75472b1e6f22', 'volume_name': 'volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da23b55e-f021-45e1-bc76-5f7ee70aab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da23b55e-f021-45e1-bc76-5f7ee70aab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d56d28-c6eb-41c7-90d8-3643609cb3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Volume 3b78c558-72c7-4ae4-ae68-75472b1e6f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22', 'volume_size': 1} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:03 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.461s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:03 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img Nov 03 17:08:03 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:10 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img" returned: 0 in 7.088s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:10 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f775a-e541-4d77-8c26-5c59ec97b88a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:11 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:08:11 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:11 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.554s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:11 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127, size 1024.00 MB, duration 7.09 sec, destination /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:08:11 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Converted 1024.00 MB image at 144.45 MB/s Nov 03 17:08:11 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9e was raw, converting to qcow2 {{(pid=86939) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 17:08:11 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e29ae6-6911-4eb1-8c42-54a194fca4f4]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:11 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img Nov 03 17:08:11 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:11 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img" returned: 0 in 0.362s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:11 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img Nov 03 17:08:11 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:12 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img" returned: 1 in 0.335s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:08:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img /opt/stack/data/cinder/conversion/vol_upload_92ddwbd_ {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:12 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img /opt/stack/data/cinder/conversion/vol_upload_92ddwbd_ Nov 03 17:08:12 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:12 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img /opt/stack/data/cinder/conversion/vol_upload_92ddwbd_" returned: 0 in 0.295s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:12 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Image conversion details: src /opt/stack/data/cinder/conversion/eb782efd-00fa-42fb-913c-f9c8b5b7e127.temp_image.d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9ex4udyfmu.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_92ddwbd_ {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:08:12 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 17:08:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c43fc7-83b3-4cd8-916d-b525ced437c1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_92ddwbd_ {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:12 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_92ddwbd_ Nov 03 17:08:12 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:12 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_92ddwbd_" returned: 0 in 0.343s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:13 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.807s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Uploaded volume to glance image-id: d87d3b1d-f6a9-416d-ad08-b89ce3bf0b9e. {{(pid=86939) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.139s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1204677917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2a59a5-7545-42b5-b9d8-f552cf78fcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:03Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Creating volume 7b2a59a5-7545-42b5-b9d8-f552cf78fcac {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:14 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:14 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac 1073741824 Nov 03 17:08:14 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:14 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c69e056d-0be5-4e2b-b351-4ae1963e2aec tempest-VolumesActionsTest-2007755646 None] Copy volume to image completed successfully. Nov 03 17:08:14 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac 1073741824" returned: 0 in 0.478s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:15 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac Nov 03 17:08:15 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:15 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac" returned: 0 in 0.319s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.629s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1047466931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b78c558-72c7-4ae4-ae68-75472b1e6f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='984feed7fdc94608a0292bee8dd6929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:04Z,use_quota=True,user_id='ab9ac072ea8d4a6384f60ebc54818bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Creating volume 3b78c558-72c7-4ae4-ae68-75472b1e6f22 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:15 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1878385-0d10-44b5-bca9-7a6872756173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:15 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 1073741824 Nov 03 17:08:15 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c15bdd3-15f0-4acd-a0c8-5b8fba923978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:15 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac (7b2a59a5-7545-42b5-b9d8-f552cf78fcac): created successfully Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c15bdd3-15f0-4acd-a0c8-5b8fba923978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (22fd65f8-aac7-4d8b-97ba-a378c9e08ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:15 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-fe0bbd8f-537f-45f9-aac9-e0426360cc92 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created volume successfully. Nov 03 17:08:16 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 1073741824" returned: 0 in 0.676s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:16 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 Nov 03 17:08:16 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Acquiring lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Acquiring lock "cinder-quobyte-eb782efd-00fa-42fb-913c-f9c8b5b7e127" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:16 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22" returned: 0 in 0.414s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Lock "cinder-quobyte-eb782efd-00fa-42fb-913c-f9c8b5b7e127" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d56d28-c6eb-41c7-90d8-3643609cb3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378b2170-e15b-4119-bb11-62b2d464db2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[525866d7-1256-43a4-aa8a-55ada46ac3f6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:16 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Volume volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 (3b78c558-72c7-4ae4-ae68-75472b1e6f22): created successfully Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378b2170-e15b-4119-bb11-62b2d464db2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Flow 'volume_create_manager' (313e0a4f-b007-4cd2-a0fd-ddf10c813f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e5a49d31-e110-47a3-af8b-29d58347e186 tempest-VolumesListAdminTestJSON-515041771 None] Created volume successfully. Nov 03 17:08:16 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:08:16 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (950f5721-9c46-40a0-8229-cf1a91746278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2bf4f3-8359-4b5e-8121-a251ec86abfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2bf4f3-8359-4b5e-8121-a251ec86abfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1503432865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a36504f-6604-4e65-8d31-632611e19290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:17Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:17 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c9cff2-4fc6-40fe-8bc1-4c729303778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c9cff2-4fc6-40fe-8bc1-4c729303778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84640942-c6a7-4382-9963-c3e5879a5010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84640942-c6a7-4382-9963-c3e5879a5010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a36504f-6604-4e65-8d31-632611e19290', 'volume_name': 'volume-2a36504f-6604-4e65-8d31-632611e19290', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fae3a5-921b-47f3-9850-616fbf20080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fae3a5-921b-47f3-9850-616fbf20080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cabe4bd-9597-448d-8ad3-35dd0266b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume 2a36504f-6604-4e65-8d31-632611e19290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a36504f-6604-4e65-8d31-632611e19290', 'volume_size': 1} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1503432865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a36504f-6604-4e65-8d31-632611e19290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:17Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Creating volume 2a36504f-6604-4e65-8d31-632611e19290 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:17 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.711s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:17 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 1073741824 Nov 03 17:08:17 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:17 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127 Nov 03 17:08:17 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:17 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-eb782efd-00fa-42fb-913c-f9c8b5b7e127" returned: 0 in 0.447s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Lock "cinder-quobyte-eb782efd-00fa-42fb-913c-f9c8b5b7e127" released by "delete_volume" :: held 1.220s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Created reservations ['75937a15-647d-4a83-8ea9-95be1a0a736a', '3e0c4dd2-ccde-4c81-a76f-84c371bd9edc', 'e174212a-203a-4376-8255-637185b35688', 'c93cac41-6b21-4aeb-8b92-e36fa7d3778b'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:17 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 1073741824" returned: 0 in 0.654s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:18 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:18 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:18 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 Nov 03 17:08:18 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Flow 'volume_create_manager' (6969a3b7-ce4b-4fde-b790-ccb70b2d5d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f838c1d6-ffbe-4002-be7e-8fcf08c7c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f838c1d6-ffbe-4002-be7e-8fcf08c7c97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-491562505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f7e870-4b6c-4a1d-838b-f108a24ef363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='984feed7fdc94608a0292bee8dd6929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:18Z,use_quota=True,user_id='ab9ac072ea8d4a6384f60ebc54818bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24118c86-4f4c-46a4-ba41-e97a2152f2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24118c86-4f4c-46a4-ba41-e97a2152f2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8d09a2-77d3-4d9c-b6fd-8ac3585dd324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8d09a2-77d3-4d9c-b6fd-8ac3585dd324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f7e870-4b6c-4a1d-838b-f108a24ef363', 'volume_name': 'volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1427520-b622-4abc-bd62-a58d83a68703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1427520-b622-4abc-bd62-a58d83a68703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8084279b-2753-4389-acfc-fc76f304e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Volume f5f7e870-4b6c-4a1d-838b-f108a24ef363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363', 'volume_size': 1} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:18 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (4cd8ab00-aa65-469e-8f85-ca3845dea6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e19f90a-6e9c-41c5-ba63-1346b1d96d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.404s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Deleted volume successfully. Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e19f90a-6e9c-41c5-ba63-1346b1d96d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076032321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a4644d-5220-4445-80f0-a67528c949a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:18Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ffae9e-94ef-43d8-822c-5766bab3fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ffae9e-94ef-43d8-822c-5766bab3fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7413a14-dd03-4a44-a433-b7e76df6c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7413a14-dd03-4a44-a433-b7e76df6c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a4644d-5220-4445-80f0-a67528c949a7', 'volume_name': 'volume-15a4644d-5220-4445-80f0-a67528c949a7', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ea250f-3c74-4a95-82f8-a55a53f4d87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ea250f-3c74-4a95-82f8-a55a53f4d87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eacfc1a-a72a-4fd9-81f7-a7524a9ac144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume 15a4644d-5220-4445-80f0-a67528c949a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a4644d-5220-4445-80f0-a67528c949a7', 'volume_size': 1} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:18 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290" returned: 0 in 0.449s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8c3dc93-6447-449e-b712-0a93dc80d646 tempest-VolumesActionsTest-2007755646 None] Lock "cinder-eb782efd-00fa-42fb-913c-f9c8b5b7e127-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-491562505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f7e870-4b6c-4a1d-838b-f108a24ef363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='984feed7fdc94608a0292bee8dd6929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:18Z,use_quota=True,user_id='ab9ac072ea8d4a6384f60ebc54818bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Creating volume f5f7e870-4b6c-4a1d-838b-f108a24ef363 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:18 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cabe4bd-9597-448d-8ad3-35dd0266b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a36504f-6604-4e65-8d31-632611e19290', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12dbf05-ff47-47f7-9253-c28c80662767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 1073741824 Nov 03 17:08:18 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume volume-2a36504f-6604-4e65-8d31-632611e19290 (2a36504f-6604-4e65-8d31-632611e19290): created successfully Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12dbf05-ff47-47f7-9253-c28c80662767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (950f5721-9c46-40a0-8229-cf1a91746278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-551e37fa-cb6e-4f76-a0d3-49419e2f4baa tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created volume successfully. Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (e9738ba0-6aab-4193-8258-ce42fd944539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0288ded8-3bec-44c2-a42d-8bf1c0c4be1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0288ded8-3bec-44c2-a42d-8bf1c0c4be1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1359881394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8ba166-fe43-4a86-8813-a9c41ce874b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:19Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d808ae2e-dd28-4376-a33e-1da96ad516a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d808ae2e-dd28-4376-a33e-1da96ad516a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4e3a19-6b4d-47f8-b736-6fe374952298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4e3a19-6b4d-47f8-b736-6fe374952298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8ba166-fe43-4a86-8813-a9c41ce874b1', 'volume_name': 'volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03fc2e3-f644-4358-a9e5-e710c0ed1a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03fc2e3-f644-4358-a9e5-e710c0ed1a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79fd8ce-4de8-4dc8-aa5d-efdae7c5ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume 5b8ba166-fe43-4a86-8813-a9c41ce874b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1', 'volume_size': 1} Nov 03 17:08:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:19 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 1073741824" returned: 0 in 0.833s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (ee7cad08-761d-4a46-8dc4-01f33db040c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668cb9ad-82a1-492c-af51-20418d9cb8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668cb9ad-82a1-492c-af51-20418d9cb8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279644969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8703635-c21c-486f-bac6-874e7688add5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:19Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa106185-690f-4965-88a4-fd01f4e8cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa106185-690f-4965-88a4-fd01f4e8cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa5a6f2-5a2e-4db2-9a77-3aa26b90ee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa5a6f2-5a2e-4db2-9a77-3aa26b90ee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8703635-c21c-486f-bac6-874e7688add5', 'volume_name': 'volume-b8703635-c21c-486f-bac6-874e7688add5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ee4d63-691c-4cbb-8314-ba5f7f300f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ee4d63-691c-4cbb-8314-ba5f7f300f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f089ca83-5589-428b-9189-31c4f146eb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume b8703635-c21c-486f-bac6-874e7688add5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8703635-c21c-486f-bac6-874e7688add5', 'volume_size': 1} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:19 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 Nov 03 17:08:19 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:19 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076032321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a4644d-5220-4445-80f0-a67528c949a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:18Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Creating volume 15a4644d-5220-4445-80f0-a67528c949a7 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:19 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:19 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 1073741824 Nov 03 17:08:19 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8084279b-2753-4389-acfc-fc76f304e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce2d721-533c-4377-842b-e2c1acb6c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (848febe0-5af3-4e4d-847b-e047c08a8f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28c418b-de85-48e3-9819-612572fe03d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Volume volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 (f5f7e870-4b6c-4a1d-838b-f108a24ef363): created successfully Nov 03 17:08:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce2d721-533c-4377-842b-e2c1acb6c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Flow 'volume_create_manager' (6969a3b7-ce4b-4fde-b790-ccb70b2d5d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28c418b-de85-48e3-9819-612572fe03d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-269224366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d1d465-0b4c-4a1a-b2ea-4b428309f72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:20Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278cb79b-dd3c-45e4-8bd1-dda610a59847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278cb79b-dd3c-45e4-8bd1-dda610a59847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f393a3-c6a0-49fc-8461-7e6ac5dc74dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f393a3-c6a0-49fc-8461-7e6ac5dc74dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d1d465-0b4c-4a1a-b2ea-4b428309f72a', 'volume_name': 'volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db85d6ed-a458-4ccb-8074-e3097f4e36a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db85d6ed-a458-4ccb-8074-e3097f4e36a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679fa3bf-efc0-4e01-84f1-588eecc67a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:20 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume 46d1d465-0b4c-4a1a-b2ea-4b428309f72a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a', 'volume_size': 1} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-94b3e356-7c54-4a44-b799-1e01013c4a25 tempest-VolumesListAdminTestJSON-515041771 None] Created volume successfully. Nov 03 17:08:20 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 1073741824" returned: 0 in 0.604s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:20 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 Nov 03 17:08:20 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:20 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1359881394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8ba166-fe43-4a86-8813-a9c41ce874b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:19Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Creating volume 5b8ba166-fe43-4a86-8813-a9c41ce874b1 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:20 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:20 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 1073741824 Nov 03 17:08:20 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eacfc1a-a72a-4fd9-81f7-a7524a9ac144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a4644d-5220-4445-80f0-a67528c949a7', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c72d3ed-da4d-4780-bbf7-474497ec1cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:20 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume volume-15a4644d-5220-4445-80f0-a67528c949a7 (15a4644d-5220-4445-80f0-a67528c949a7): created successfully Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c72d3ed-da4d-4780-bbf7-474497ec1cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (4cd8ab00-aa65-469e-8f85-ca3845dea6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a03bdf8e-eec6-41d3-aa96-3b22d6899905 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created volume successfully. Nov 03 17:08:21 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 1073741824" returned: 0 in 0.710s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:21 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 Nov 03 17:08:21 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:21 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1" returned: 0 in 0.325s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.486s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279644969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8703635-c21c-486f-bac6-874e7688add5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:19Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Creating volume b8703635-c21c-486f-bac6-874e7688add5 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:21 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79fd8ce-4de8-4dc8-aa5d-efdae7c5ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:21 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 1073741824 Nov 03 17:08:21 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919fee29-5944-47ec-8ea6-85485baf2488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 (5b8ba166-fe43-4a86-8813-a9c41ce874b1): created successfully Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919fee29-5944-47ec-8ea6-85485baf2488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (e9738ba0-6aab-4193-8258-ce42fd944539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8aa37df2-54ea-4f67-86b8-2b52a8966493 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created volume successfully. Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Flow 'volume_create_manager' (1e1cbd71-9381-4b03-b09c-bbf4e7e458a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f4c4e9-930e-4064-b20d-62748f81a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f4c4e9-930e-4064-b20d-62748f81a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12ee2e9-3a8e-4a50-8da9-00adbc3db31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5534ad0c8e944f9194b7faa4425203e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:22Z,use_quota=True,user_id='24d3cbf3c19f43229149a3991ba75075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1d0d06-f5de-4efe-8caa-78bf80243a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1d0d06-f5de-4efe-8caa-78bf80243a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a40de198-7a1c-4f66-a914-9b6b50dd0d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a40de198-7a1c-4f66-a914-9b6b50dd0d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12ee2e9-3a8e-4a50-8da9-00adbc3db31f', 'volume_name': 'volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad7b0b2-5b1d-4050-8c17-142173bfdadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad7b0b2-5b1d-4050-8c17-142173bfdadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09fab22-0ade-44ef-97b2-228f2f512fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Volume f12ee2e9-3a8e-4a50-8da9-00adbc3db31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f', 'volume_size': 1} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:22 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 1073741824" returned: 0 in 0.716s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:22 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 Nov 03 17:08:22 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:22 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5" returned: 0 in 0.258s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.879s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-269224366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d1d465-0b4c-4a1a-b2ea-4b428309f72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730c6a5ac5a04d159703e3dedbe713bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:20Z,use_quota=True,user_id='d2418cfb73a34c13b10e8a422b69fb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Creating volume 46d1d465-0b4c-4a1a-b2ea-4b428309f72a {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:22 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f089ca83-5589-428b-9189-31c4f146eb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8703635-c21c-486f-bac6-874e7688add5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a 1073741824 Nov 03 17:08:22 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f07c99d-3f5b-4c2f-8487-b061835f93a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:23 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume volume-b8703635-c21c-486f-bac6-874e7688add5 (b8703635-c21c-486f-bac6-874e7688add5): created successfully Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f07c99d-3f5b-4c2f-8487-b061835f93a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (ee7cad08-761d-4a46-8dc4-01f33db040c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b94cccc1-8969-4e5d-af75-c410dd7f09a3 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created volume successfully. Nov 03 17:08:23 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a 1073741824" returned: 0 in 0.574s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:23 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a Nov 03 17:08:23 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:23 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a" returned: 0 in 0.363s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12ee2e9-3a8e-4a50-8da9-00adbc3db31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5534ad0c8e944f9194b7faa4425203e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:22Z,use_quota=True,user_id='24d3cbf3c19f43229149a3991ba75075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Creating volume f12ee2e9-3a8e-4a50-8da9-00adbc3db31f {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:24 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679fa3bf-efc0-4e01-84f1-588eecc67a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632b4aa3-d5cf-4e31-9e3c-567ebe1f5aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:24 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f 1073741824 Nov 03 17:08:24 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:24 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Volume volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a (46d1d465-0b4c-4a1a-b2ea-4b428309f72a): created successfully Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632b4aa3-d5cf-4e31-9e3c-567ebe1f5aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Flow 'volume_create_manager' (848febe0-5af3-4e4d-847b-e047c08a8f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-05532329-bebe-433a-9aa2-46f7a7d11568 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created volume successfully. Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-46d1d465-0b4c-4a1a-b2ea-4b428309f72a-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-46d1d465-0b4c-4a1a-b2ea-4b428309f72a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-quobyte-46d1d465-0b4c-4a1a-b2ea-4b428309f72a" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-46d1d465-0b4c-4a1a-b2ea-4b428309f72a" acquired by "delete_volume" :: waited 0.048s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fb99f9-6800-4e42-8a17-8a29578ed300]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:24 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f 1073741824" returned: 0 in 0.718s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:24 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a Nov 03 17:08:24 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:24 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f Nov 03 17:08:24 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:25 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a" returned: 0 in 0.505s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:25 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a Nov 03 17:08:25 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:25 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f" returned: 0 in 0.451s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09fab22-0ade-44ef-97b2-228f2f512fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0302d815-7c99-47ed-a43d-68be6f764f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:25 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Volume volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f (f12ee2e9-3a8e-4a50-8da9-00adbc3db31f): created successfully Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0302d815-7c99-47ed-a43d-68be6f764f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Flow 'volume_create_manager' (1e1cbd71-9381-4b03-b09c-bbf4e7e458a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1a012e8a-2c40-4b34-b3f4-4a320a714234 tempest-VolumesListAdminTestJSON-1586697090 None] Created volume successfully. Nov 03 17:08:25 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-46d1d465-0b4c-4a1a-b2ea-4b428309f72a" returned: 0 in 0.362s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-46d1d465-0b4c-4a1a-b2ea-4b428309f72a" released by "delete_volume" :: held 0.945s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created reservations ['e4c50110-a502-4635-b97d-7ec2ea9f3d7e', '96256f0c-f1fd-4759-8d5d-ee3d23a031f5', '651fe900-8e4c-4307-93d6-2f7c0958a733', '1c76ef19-faf0-4c43-ad78-c598c9efc280'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Acquiring lock "cinder-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "cinder-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:25 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:25 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Acquiring lock "cinder-quobyte-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "cinder-quobyte-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f" acquired by "delete_volume" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cb7450-021d-46d6-8527-498b73d78e77]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "cinder-f5f7e870-4b6c-4a1d-838b-f108a24ef363-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-f5f7e870-4b6c-4a1d-838b-f108a24ef363-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "cinder-quobyte-f5f7e870-4b6c-4a1d-838b-f108a24ef363" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-quobyte-f5f7e870-4b6c-4a1d-838b-f108a24ef363" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:26 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:26 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.358s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:26 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Deleted volume successfully. Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef99873-3915-411d-8d86-78654ade41fe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-88c7d440-15ae-4500-9dbe-46cdff8ff849 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-46d1d465-0b4c-4a1a-b2ea-4b428309f72a-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:26 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 Nov 03 17:08:26 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:26 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f" returned: 0 in 0.573s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:26 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f Nov 03 17:08:26 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:26 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363" returned: 0 in 0.606s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:26 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363 Nov 03 17:08:26 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-b8703635-c21c-486f-bac6-874e7688add5-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-b8703635-c21c-486f-bac6-874e7688add5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-quobyte-b8703635-c21c-486f-bac6-874e7688add5" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-b8703635-c21c-486f-bac6-874e7688add5" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b6f07-22f7-473b-a121-55a87ef60088]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:27 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f" returned: 0 in 0.524s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "cinder-quobyte-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f" released by "delete_volume" :: held 1.169s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:27 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 Nov 03 17:08:27 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Created reservations ['328d1f67-9660-428c-8089-86657b53ba3b', 'a00b49fb-addd-45df-b3ad-86bc7cb34dab', '3cac8d44-1416-4322-b8e2-53f205701fc6', '4afa2aaf-798b-495f-b2b8-7b6c1fcebfc7'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:27 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-f5f7e870-4b6c-4a1d-838b-f108a24ef363" returned: 0 in 0.539s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:27 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-quobyte-f5f7e870-4b6c-4a1d-838b-f108a24ef363" released by "delete_volume" :: held 1.267s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Created reservations ['f8a14ade-c506-49f0-9180-1d6c4bac726a', '01bde8a8-bcd8-4b35-94b3-71ceb183e6c5', 'ba03e73f-59eb-4a73-9606-687eb98cd083', '17af4cc2-5fb6-4e2e-bf73-05b4dd67cf95'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:27 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:27 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:27 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5" returned: 0 in 0.657s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:27 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5 Nov 03 17:08:27 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:27 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.555s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Deleted volume successfully. Nov 03 17:08:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c5e9e365-d73c-4cad-9307-0c680e328ae1 tempest-VolumesListAdminTestJSON-1586697090 None] Lock "cinder-f12ee2e9-3a8e-4a50-8da9-00adbc3db31f-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:28 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.398s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Deleted volume successfully. Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d4b5fe2b-d9c9-4db5-af66-b90ca68eaf11 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-f5f7e870-4b6c-4a1d-838b-f108a24ef363-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:28 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b8703635-c21c-486f-bac6-874e7688add5" returned: 0 in 0.551s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-b8703635-c21c-486f-bac6-874e7688add5" released by "delete_volume" :: held 1.287s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "cinder-3b78c558-72c7-4ae4-ae68-75472b1e6f22-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created reservations ['3c6ce897-ff6d-4a11-9bab-fc0db73da359', 'e91643f9-bccd-4e08-baf7-9394738a559d', '887a06c9-2985-448f-ac11-1c8221dce39c', '538279fe-f825-4576-be0b-c0d547ceda0a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-3b78c558-72c7-4ae4-ae68-75472b1e6f22-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "cinder-quobyte-3b78c558-72c7-4ae4-ae68-75472b1e6f22" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-quobyte-3b78c558-72c7-4ae4-ae68-75472b1e6f22" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[610cff4f-4471-426b-8c21-8fdc60ec0160]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:28 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:28 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:28 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 Nov 03 17:08:28 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:28 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.297s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:28 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Deleted volume successfully. Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-703ee1ee-609d-429e-a031-f5ec6028a475 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-b8703635-c21c-486f-bac6-874e7688add5-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-5b8ba166-fe43-4a86-8813-a9c41ce874b1-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-5b8ba166-fe43-4a86-8813-a9c41ce874b1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-quobyte-5b8ba166-fe43-4a86-8813-a9c41ce874b1" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:29 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22" returned: 0 in 0.699s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-5b8ba166-fe43-4a86-8813-a9c41ce874b1" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:29 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22 Nov 03 17:08:29 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b296495f-edf6-4163-863c-97a881f34e71]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:29 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 Nov 03 17:08:29 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:29 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b78c558-72c7-4ae4-ae68-75472b1e6f22" returned: 0 in 0.473s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-quobyte-3b78c558-72c7-4ae4-ae68-75472b1e6f22" released by "delete_volume" :: held 1.268s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:29 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Created reservations ['82050af4-87ed-49f7-86fe-68edf3d8e308', 'd98326b5-2efa-49f6-9052-e6ace5b38dd2', '489e35d3-f965-49fa-9ce2-b530505c5cdb', '371f05c8-6734-430e-8c9f-40dbbe135132'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:30 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1" returned: 0 in 0.645s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:30 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1 Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:30 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:30 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:30 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:30 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.378s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:30 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Deleted volume successfully. Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b8ba166-fe43-4a86-8813-a9c41ce874b1" returned: 0 in 0.470s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-5b8ba166-fe43-4a86-8813-a9c41ce874b1" released by "delete_volume" :: held 1.184s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d5fa7534-2ac7-4df6-a397-2d8568abed71 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-3b78c558-72c7-4ae4-ae68-75472b1e6f22-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created reservations ['8f31007e-4556-4417-af89-cb12c75e0bf4', 'a8880e42-6e22-40e1-88b4-677c4a1aad9d', 'a3536396-6945-445a-9d30-6a4f48a3359b', 'a5318148-60cb-466f-bcb7-c6d899577f48'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:30 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:30 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "cinder-e77cf9c7-7521-4548-b617-86897b655360-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:30 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:30 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-e77cf9c7-7521-4548-b617-86897b655360-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "cinder-quobyte-e77cf9c7-7521-4548-b617-86897b655360" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-quobyte-e77cf9c7-7521-4548-b617-86897b655360" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c2ca0-e2cb-4aa0-8321-be1503317a0a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:31 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.366s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Deleted volume successfully. Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e8aae018-4072-4557-8f73-686ec61f15af tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-5b8ba166-fe43-4a86-8813-a9c41ce874b1-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:31 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 Nov 03 17:08:31 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:31 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.465s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:08:31 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360" returned: 0 in 0.554s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-15a4644d-5220-4445-80f0-a67528c949a7-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:31 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360 Nov 03 17:08:31 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-15a4644d-5220-4445-80f0-a67528c949a7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-quobyte-15a4644d-5220-4445-80f0-a67528c949a7" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-15a4644d-5220-4445-80f0-a67528c949a7" acquired by "delete_volume" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc39b3-46f7-4e70-b097-0461d05cd3d0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:32 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 Nov 03 17:08:32 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:32 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e77cf9c7-7521-4548-b617-86897b655360" returned: 0 in 0.486s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-quobyte-e77cf9c7-7521-4548-b617-86897b655360" released by "delete_volume" :: held 1.118s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Created reservations ['d369dd70-408a-4dd5-8f4b-4b8c6a2e586d', '366973f3-9f13-4505-914d-b577382bc5c2', 'c6ee3bea-b070-40b7-bdeb-b0292b595f57', '4eafb71d-026e-43ab-96a7-23cef9b03ccc'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:32 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:32 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:32 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7" returned: 0 in 0.585s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:32 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7 Nov 03 17:08:32 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:32 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.361s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:32 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Deleted volume successfully. Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38e7509e-c79c-4db8-b833-5d3d7189fce3 tempest-VolumesListAdminTestJSON-515041771 None] Lock "cinder-e77cf9c7-7521-4548-b617-86897b655360-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:32 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-15a4644d-5220-4445-80f0-a67528c949a7" returned: 0 in 0.335s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-15a4644d-5220-4445-80f0-a67528c949a7" released by "delete_volume" :: held 0.990s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created reservations ['82278971-9640-47fb-81bd-85404efb33a1', 'b999d7fb-1464-4276-9e6d-61f250eb4863', '841ac235-2919-4313-ba49-cdfacd23a324', 'e2c096b5-0094-4d95-9c9c-5d6910e39439'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:33 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:33 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:33 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.428s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Deleted volume successfully. Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9efb81c0-3094-4d96-b1ca-dcd0995e1783 tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-15a4644d-5220-4445-80f0-a67528c949a7-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Flow 'volume_create_manager' (43195048-2206-48c4-9b0c-1b7e74d0dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a5d2d9-84a2-41c8-b676-25efecc98d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a5d2d9-84a2-41c8-b676-25efecc98d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-181661833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed12416-c9a9-463b-8da6-afe9fc626254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5405019ec824b5c9cef6749b3ff05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:34Z,use_quota=True,user_id='4ee482e2ed4f45ee9d8b196ec882d565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870aa00b-04af-40bd-8598-7d7d8ed07fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870aa00b-04af-40bd-8598-7d7d8ed07fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6f74e1-175e-4748-aca4-b4797bec4900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6f74e1-175e-4748-aca4-b4797bec4900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed12416-c9a9-463b-8da6-afe9fc626254', 'volume_name': 'volume-aed12416-c9a9-463b-8da6-afe9fc626254', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88886731-b44a-41ae-8065-a67762b15468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88886731-b44a-41ae-8065-a67762b15468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75c3533-51ca-4fbb-a59c-f125ed5ed569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:33 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Volume aed12416-c9a9-463b-8da6-afe9fc626254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed12416-c9a9-463b-8da6-afe9fc626254', 'volume_size': 1} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-181661833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed12416-c9a9-463b-8da6-afe9fc626254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5405019ec824b5c9cef6749b3ff05be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:34Z,use_quota=True,user_id='4ee482e2ed4f45ee9d8b196ec882d565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Creating volume aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:33 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:33 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 1073741824 Nov 03 17:08:33 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-2a36504f-6604-4e65-8d31-632611e19290-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-2a36504f-6604-4e65-8d31-632611e19290-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-quobyte-2a36504f-6604-4e65-8d31-632611e19290" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-2a36504f-6604-4e65-8d31-632611e19290" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1becf89-67c7-4f7a-8796-e2c05d863b5d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:34 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 Nov 03 17:08:34 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:34 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 1073741824" returned: 0 in 0.681s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:34 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 Nov 03 17:08:34 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:34 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290" returned: 0 in 0.576s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:34 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254" returned: 0 in 0.347s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:34 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290 Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:34 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75c3533-51ca-4fbb-a59c-f125ed5ed569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed12416-c9a9-463b-8da6-afe9fc626254', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6f983d-d242-4f4f-9485-b003545a5b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:34 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Volume volume-aed12416-c9a9-463b-8da6-afe9fc626254 (aed12416-c9a9-463b-8da6-afe9fc626254): created successfully Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6f983d-d242-4f4f-9485-b003545a5b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Flow 'volume_create_manager' (43195048-2206-48c4-9b0c-1b7e74d0dc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1b78c20d-320f-443b-ac62-20cb9994d15c tempest-VolumesSnapshotListTestJSON-679480928 None] Created volume successfully. Nov 03 17:08:35 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2a36504f-6604-4e65-8d31-632611e19290" returned: 0 in 0.335s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-2a36504f-6604-4e65-8d31-632611e19290" released by "delete_volume" :: held 0.987s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created reservations ['cb74da4c-7cad-412b-8bb1-9001cd80542e', '4d942970-dd72-4a83-a2ed-db30abe283cb', 'e57c9892-d248-46a3-87cd-323cb0b43e03', '840711a0-d4fc-42d7-8dc7-714bb1674b92'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:35 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:35 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:35 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.294s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:35 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Deleted volume successfully. Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5505040-c05d-4b83-ade3-c1a5fd7aa3cd tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-2a36504f-6604-4e65-8d31-632611e19290-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Creating offline snapshot fee7de4c-f13a-4957-86da-2df78ee8df18 of volume aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80a0789-5a81-4922-8e17-1a040c97fd75]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:36 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 Nov 03 17:08:36 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-7b2a59a5-7545-42b5-b9d8-f552cf78fcac-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-7b2a59a5-7545-42b5-b9d8-f552cf78fcac-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Flow 'volume_create_manager' (aa0094ee-6e94-48c6-9363-24e7f02812f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7eb2a7-1cba-4a25-8c02-ca0016146f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7eb2a7-1cba-4a25-8c02-ca0016146f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1999009406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce48c9ae-f367-457c-9667-1f88c4ab5666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fde37c0bd245178321da0c16b0b6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:36Z,use_quota=True,user_id='a9c82e75bb6242ddbaa34d7fa1e7458f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbcf931-278d-47d5-93c1-08672ac6fd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbcf931-278d-47d5-93c1-08672ac6fd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ed690f-0b68-4cff-b6c8-43d37a3d993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:08:36 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "cinder-quobyte-7b2a59a5-7545-42b5-b9d8-f552cf78fcac" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254" returned: 0 in 0.578s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-7b2a59a5-7545-42b5-b9d8-f552cf78fcac" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:36 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 1G Nov 03 17:08:36 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d20bb5-035f-4d29-b3d7-c51395f703e7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:36 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac Nov 03 17:08:36 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ed690f-0b68-4cff-b6c8-43d37a3d993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce48c9ae-f367-457c-9667-1f88c4ab5666', 'volume_name': 'volume-ce48c9ae-f367-457c-9667-1f88c4ab5666', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2739bab-b47e-40d0-9a66-fbb4e1c03d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2739bab-b47e-40d0-9a66-fbb4e1c03d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05961d60-9f53-4881-982b-0196137674fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:36 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Volume ce48c9ae-f367-457c-9667-1f88c4ab5666: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce48c9ae-f367-457c-9667-1f88c4ab5666', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:08:36 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Trying to clone ce48c9ae-f367-457c-9667-1f88c4ab5666 from image d3081758-5b01-49fb-b109-4441003b66a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:08:37 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 1G" returned: 0 in 0.551s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:37 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:37 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 Nov 03 17:08:37 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac" returned: 0 in 0.546s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:37 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac Nov 03 17:08:37 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:37 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7b2a59a5-7545-42b5-b9d8-f552cf78fcac" returned: 0 in 0.363s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:37 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18" returned: 0 in 0.464s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:37 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 is being set with open permissions: ugo+rw Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-quobyte-7b2a59a5-7545-42b5-b9d8-f552cf78fcac" released by "delete_volume" :: held 1.015s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:37 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 Nov 03 17:08:37 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:08:37 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Created reservations ['050c8f30-a2cb-4c94-b485-7ee384b4bb34', '1e6cc0f1-345a-49e2-94d5-a3466588110b', '897fbd6c-fca8-4c9a-907b-93d25759b395', '7f2a6b67-5383-4dff-bc6a-e23140cb38d9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa0a23d-be5a-4a94-bc88-8715197ce8d7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:37 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:08:37 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:37 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD Nov 03 17:08:37 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:37 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18" returned: 0 in 0.325s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:37 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.info Nov 03 17:08:37 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:38 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 is fetched for user a9c82e75bb6242ddbaa34d7fa1e7458f. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:08:38 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.330s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Deleted volume successfully. Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19801e36-2a51-4270-98c6-6ba1b1ee84cc tempest-CreateVolumesFromSourceVolumeTest-1601425239 None] Lock "cinder-7b2a59a5-7545-42b5-b9d8-f552cf78fcac-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d335c04e-5c6a-4253-8a3d-670e89109b2e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:38 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.info" returned: 0 in 0.334s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:38 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.info is being set with open permissions: ugo+rw Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:38 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.info Nov 03 17:08:38 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:38 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD Nov 03 17:08:38 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:38 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.info" returned: 0 in 0.292s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:38 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1999009406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce48c9ae-f367-457c-9667-1f88c4ab5666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fde37c0bd245178321da0c16b0b6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:36Z,use_quota=True,user_id='a9c82e75bb6242ddbaa34d7fa1e7458f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Creating volume ce48c9ae-f367-457c-9667-1f88c4ab5666 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:38 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:38 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 1073741824 Nov 03 17:08:38 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cfd270f7-5a2e-476f-ac5d-adcaf0bb2fbe tempest-VolumesSnapshotListTestJSON-679480928 None] Create snapshot completed successfully Nov 03 17:08:39 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 1073741824" returned: 0 in 0.569s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:39 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 Nov 03 17:08:39 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:39 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666" returned: 0 in 0.381s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.198s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Creating offline snapshot 6c6251a4-3b06-4e57-be08-81a90f2d46cd of volume aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Attempting download of d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume ce48c9ae-f367-457c-9667-1f88c4ab5666. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[020a6b73-375d-4398-a194-30434b790048]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ff697-8620-42a2-83f2-0f16a1edbdf5]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_kem8h7dn {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:39 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 Nov 03 17:08:39 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:39 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_kem8h7dn Nov 03 17:08:39 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:40 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18" returned: 0 in 0.453s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed12416-c9a9-463b-8da6-afe9fc626254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:40 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd 1G Nov 03 17:08:40 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:40 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_kem8h7dn" returned: 0 in 0.495s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_kem8h7dn {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:40 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_kem8h7dn Nov 03 17:08:40 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:40 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_kem8h7dn" returned: 1 in 0.404s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8_kem8h7dn' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[de166909-0da1-4910-8011-23e9b38a5322]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:40 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd 1G" returned: 0 in 0.640s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:40 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD Nov 03 17:08:40 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:40 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd Nov 03 17:08:40 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:41 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:41 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] d3081758-5b01-49fb-b109-4441003b66a8 was qcow2, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:08:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:41 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 Nov 03 17:08:41 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:41 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd" returned: 0 in 0.441s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:41 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd is being set with open permissions: ugo+rw Nov 03 17:08:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:41 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd Nov 03 17:08:41 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:41 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd" returned: 0 in 0.375s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e71cfb85-a877-4d46-adbb-7c3d44590fff tempest-VolumesSnapshotListTestJSON-679480928 None] Create snapshot completed successfully Nov 03 17:08:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Creating offline snapshot 4c9bade3-231a-4ffd-a806-1fe3d16793a1 of volume aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:08:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1e527c-9f96-4e31-b8ce-08a24d9ff611]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:43 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd Nov 03 17:08:43 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:43 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd" returned: 0 in 0.690s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed12416-c9a9-463b-8da6-afe9fc626254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:43 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 1G Nov 03 17:08:43 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:43 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666" returned: 0 in 2.927s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_gby7ago5devstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:08:44 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Converted 112.00 MB image at 38.19 MB/s Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:44 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 1G Nov 03 17:08:44 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:44 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 1G" returned: 0 in 0.441s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Downloaded image d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume ce48c9ae-f367-457c-9667-1f88c4ab5666 successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 for user a9c82e75bb6242ddbaa34d7fa1e7458f is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Marking volume ce48c9ae-f367-457c-9667-1f88c4ab5666 as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Copying metadata from image d3081758-5b01-49fb-b109-4441003b66a8 to ce48c9ae-f367-457c-9667-1f88c4ab5666. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Creating volume glance metadata for volume ce48c9ae-f367-457c-9667-1f88c4ab5666 backed by image d3081758-5b01-49fb-b109-4441003b66a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:08:44 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 1G" returned: 0 in 0.754s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:44 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 Nov 03 17:08:44 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05961d60-9f53-4881-982b-0196137674fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce48c9ae-f367-457c-9667-1f88c4ab5666', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9768a96e-63c5-42ff-920d-bed63210ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Volume volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 (ce48c9ae-f367-457c-9667-1f88c4ab5666): created successfully Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9768a96e-63c5-42ff-920d-bed63210ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Flow 'volume_create_manager' (aa0094ee-6e94-48c6-9363-24e7f02812f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d11453b1-afc7-4a45-9e88-241c0a24ce8e tempest-TestShelveInstance-2028148084 None] Created volume successfully. Nov 03 17:08:44 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1" returned: 0 in 0.355s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:44 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 is being set with open permissions: ugo+rw Nov 03 17:08:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:44 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 Nov 03 17:08:44 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:45 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1" returned: 0 in 0.385s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3b8ff230-744b-42d3-ae49-c6f205a48e50 tempest-VolumesSnapshotListTestJSON-679480928 None] Create snapshot completed successfully Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Flow 'volume_create_manager' (1b668f47-e443-4f6d-848a-885ced4f958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5698a1a3-74de-45cc-bbd8-5dd7cfb8ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5698a1a3-74de-45cc-bbd8-5dd7cfb8ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1742481730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='447bb8d59b3047e39d5e7f825129eed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:46Z,use_quota=True,user_id='a2592279638148c5b9acc31e91b94581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55458360-6ed8-45ca-b4aa-4e9382ec37b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55458360-6ed8-45ca-b4aa-4e9382ec37b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2be9a99-58bc-4e4f-8283-82811bd4cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2be9a99-58bc-4e4f-8283-82811bd4cd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6', 'volume_name': 'volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b651d98c-6a57-4e78-924b-3f1247b4b37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b651d98c-6a57-4e78-924b-3f1247b4b37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9589273b-256d-4cac-8101-1ba33e716706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:45 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Volume fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6', 'volume_size': 1} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1742481730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='447bb8d59b3047e39d5e7f825129eed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:46Z,use_quota=True,user_id='a2592279638148c5b9acc31e91b94581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Creating volume fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:45 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:08:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:45 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 1073741824 Nov 03 17:08:45 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:46 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 1073741824" returned: 0 in 0.641s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:46 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 Nov 03 17:08:46 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:46 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" returned: 0 in 0.384s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9589273b-256d-4cac-8101-1ba33e716706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f816a8c-98cf-4186-a164-5b8863aada45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:46 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Volume volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 (fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6): created successfully Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f816a8c-98cf-4186-a164-5b8863aada45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Flow 'volume_create_manager' (1b668f47-e443-4f6d-848a-885ced4f958a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f24fa621-ad21-48ea-bcd9-f52fd102fe09 tempest-VolumesCloneTest-1031357823 None] Created volume successfully. Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-4c9bade3-231a-4ffd-a806-1fe3d16793a1-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-4c9bade3-231a-4ffd-a806-1fe3d16793a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-quobyte-4c9bade3-231a-4ffd-a806-1fe3d16793a1" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-4c9bade3-231a-4ffd-a806-1fe3d16793a1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Deleting offline snapshot 4c9bade3-231a-4ffd-a806-1fe3d16793a1 of volume aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] snapshot_file for this snap is: volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199e1dc-252c-46f8-af60-424531131de8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:47 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 Nov 03 17:08:47 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:48 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1" returned: 0 in 0.530s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed12416-c9a9-463b-8da6-afe9fc626254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6447380c-4d35-4205-ade3-e26de46154fe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:48 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd Nov 03 17:08:48 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Flow 'volume_create_manager' (5ae75203-e45c-4a9e-bd07-ccdaa2738350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59cc874-bf3c-46a7-a0f2-021ced2c6f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59cc874-bf3c-46a7-a0f2-021ced2c6f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-71858874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826ea65f-527c-4d4e-8432-ee6371673458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='447bb8d59b3047e39d5e7f825129eed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:49Z,use_quota=True,user_id='a2592279638148c5b9acc31e91b94581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb349cd-fc62-4723-8e39-3715d37d9482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb349cd-fc62-4723-8e39-3715d37d9482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41910bf-462d-4032-bb15-c5c3f705954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41910bf-462d-4032-bb15-c5c3f705954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '826ea65f-527c-4d4e-8432-ee6371673458', 'volume_name': 'volume-826ea65f-527c-4d4e-8432-ee6371673458', 'volume_size': 2, 'source_volid': 'fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6', 'source_volstatus': 'available'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d0633b-cea3-4253-9d63-b0f625da0ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d0633b-cea3-4253-9d63-b0f625da0ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188c836-647d-4765-b2f0-68fe97e75bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Volume 826ea65f-527c-4d4e-8432-ee6371673458: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-826ea65f-527c-4d4e-8432-ee6371673458', 'volume_size': 2, 'source_volid': 'fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6', 'source_volstatus': 'available'} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-e225162a-1e5f-4bd1-b629-95361ff7199f req-97a19051-6171-4b30-8dec-1914998fbe98 tempest-TestShelveInstance-2028148084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-e225162a-1e5f-4bd1-b629-95361ff7199f req-97a19051-6171-4b30-8dec-1914998fbe98 tempest-TestShelveInstance-2028148084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-e225162a-1e5f-4bd1-b629-95361ff7199f req-97a19051-6171-4b30-8dec-1914998fbe98 tempest-TestShelveInstance-2028148084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:48 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Cloning volume fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 to volume 826ea65f-527c-4d4e-8432-ee6371673458 Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Creating offline snapshot 15315b03-7148-4a50-bc50-afadd40676bb of volume fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:08:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-e225162a-1e5f-4bd1-b629-95361ff7199f req-97a19051-6171-4b30-8dec-1914998fbe98 tempest-TestShelveInstance-2028148084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-ce48c9ae-f367-457c-9667-1f88c4ab5666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc03ddb8-d3d0-49b5-bfc2-a1264810c9c3', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7536aa92-d341-4a23-8b8b-791714312b71]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:49 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd" returned: 0 in 0.680s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed12416-c9a9-463b-8da6-afe9fc626254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:49 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 Nov 03 17:08:49 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-e225162a-1e5f-4bd1-b629-95361ff7199f req-97a19051-6171-4b30-8dec-1914998fbe98 tempest-TestShelveInstance-2028148084 None] attachment_update completed successfully. Nov 03 17:08:49 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 Nov 03 17:08:49 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:49 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" returned: 0 in 0.749s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:49 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1" returned: 0 in 0.749s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:49 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1 Nov 03 17:08:49 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:49 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb 1G Nov 03 17:08:49 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:50 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.4c9bade3-231a-4ffd-a806-1fe3d16793a1" returned: 0 in 0.332s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-4c9bade3-231a-4ffd-a806-1fe3d16793a1" released by "_delete_snapshot" :: held 2.501s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" released by "delete_snapshot" :: held 2.539s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Created reservations ['7fce1cad-f803-4dcb-bae8-d6b2fea1e6f8', '517db69d-8eed-464a-83fb-78f5d1d61025', '07256a7a-947b-4da2-a03e-846ec5384f2e', 'f189ea31-9fc2-4c4d-bf3d-73571c28a0c4'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:50 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Delete snapshot completed successfully. Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee1f500e-281c-4e61-9f8a-c040361ef450 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-4c9bade3-231a-4ffd-a806-1fe3d16793a1-delete_snapshot" released by "delete_snapshot" :: held 2.762s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:50 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb 1G" returned: 0 in 0.676s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:50 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb Nov 03 17:08:50 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:50 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb" returned: 0 in 0.345s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:50 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb is being set with open permissions: ugo+rw Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:50 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb Nov 03 17:08:50 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-6c6251a4-3b06-4e57-be08-81a90f2d46cd-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-6c6251a4-3b06-4e57-be08-81a90f2d46cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-quobyte-6c6251a4-3b06-4e57-be08-81a90f2d46cd" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-6c6251a4-3b06-4e57-be08-81a90f2d46cd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Deleting offline snapshot 6c6251a4-3b06-4e57-be08-81a90f2d46cd of volume aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] snapshot_file for this snap is: volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f44e43-f267-4fbc-8c19-47d8887a5b48]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:51 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb" returned: 0 in 0.376s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:51 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.info Nov 03 17:08:51 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:51 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd Nov 03 17:08:51 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:51 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.info" returned: 0 in 0.417s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:51 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.info is being set with open permissions: ugo+rw Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:51 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd" returned: 0 in 0.563s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed12416-c9a9-463b-8da6-afe9fc626254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:51 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.info Nov 03 17:08:51 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[172a805c-39ee-40f4-8f72-1036925b93d1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:51 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 Nov 03 17:08:51 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:51 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.info" returned: 0 in 0.319s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "cinder-quobyte-826ea65f-527c-4d4e-8432-ee6371673458" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-quobyte-826ea65f-527c-4d4e-8432-ee6371673458" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] snapshot: 15315b03-7148-4a50-bc50-afadd40676bb, volume: 826ea65f-527c-4d4e-8432-ee6371673458, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[942fb393-e820-498c-9fde-7a56c46488fb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:52 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18" returned: 0 in 0.515s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed12416-c9a9-463b-8da6-afe9fc626254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:52 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb Nov 03 17:08:52 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:52 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd Nov 03 17:08:52 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:52 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb" returned: 0 in 0.788s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10ef568-32b8-49a8-8a65-acf94e6f5962]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:53 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd" returned: 0 in 0.944s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:53 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 Nov 03 17:08:53 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:53 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd Nov 03 17:08:53 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:53 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.6c6251a4-3b06-4e57-be08-81a90f2d46cd" returned: 0 in 0.506s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-6c6251a4-3b06-4e57-be08-81a90f2d46cd" released by "_delete_snapshot" :: held 2.742s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" released by "delete_snapshot" :: held 2.788s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:53 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" returned: 0 in 0.917s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:08:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:53 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 Nov 03 17:08:53 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Created reservations ['4308ddf0-bd3e-45f2-8e01-b4d7f2a483f3', 'd69f3777-d995-46cd-b194-c826dfbd7683', '1b734fdb-ab70-48d8-a2b2-ef682c0c8ea5', '315dcf2e-a9c5-48f1-bd80-b7a78c305277'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Delete snapshot completed successfully. Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-885cfd84-8e34-405f-8159-a302eec0563e tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-6c6251a4-3b06-4e57-be08-81a90f2d46cd-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-fee7de4c-f13a-4957-86da-2df78ee8df18-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-fee7de4c-f13a-4957-86da-2df78ee8df18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-quobyte-fee7de4c-f13a-4957-86da-2df78ee8df18" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-fee7de4c-f13a-4957-86da-2df78ee8df18" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Deleting offline snapshot fee7de4c-f13a-4957-86da-2df78ee8df18 of volume aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] snapshot_file for this snap is: volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e3f97f-f956-4c0e-b583-ab77e87ee513]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:54 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 Nov 03 17:08:54 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:55 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18" returned: 0 in 0.935s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed12416-c9a9-463b-8da6-afe9fc626254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:55 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfb91bb-1f72-4853-a4b3-f8d507839960]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:56 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 Nov 03 17:08:56 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:57 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254" returned: 0 in 1.657s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:57 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 Nov 03 17:08:57 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:58 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18" returned: 0 in 1.203s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:58 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18 Nov 03 17:08:58 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:59 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254.fee7de4c-f13a-4957-86da-2df78ee8df18" returned: 0 in 0.904s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:59 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=115,cinder:UPDATE=149,cinder:INSERT=40,cinder:DELETE=14 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:08:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-fee7de4c-f13a-4957-86da-2df78ee8df18" released by "_delete_snapshot" :: held 5.091s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" released by "delete_snapshot" :: held 5.174s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:59 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Created reservations ['8a949561-1add-4df1-8be8-613d64098a2e', 'a66db590-0457-4aae-8457-101dfdd1441f', '3d80dbb8-d2e2-46f8-85b7-906277d4595a', '9e981170-1747-4b56-ac0a-d514e2c09f69'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Delete snapshot completed successfully. Nov 03 17:09:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98dd48c3-636d-4f84-97e4-40acfa251095 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-fee7de4c-f13a-4957-86da-2df78ee8df18-delete_snapshot" released by "delete_snapshot" :: held 5.876s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-aed12416-c9a9-463b-8da6-afe9fc626254-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-aed12416-c9a9-463b-8da6-afe9fc626254-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" acquired by "delete_volume" :: waited 0.076s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be292c-1eb3-4314-b157-f0f69fe38c00]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:02 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 Nov 03 17:09:02 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:04 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254" returned: 0 in 2.079s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:04 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254 Nov 03 17:09:04 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:05 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-aed12416-c9a9-463b-8da6-afe9fc626254" returned: 0 in 1.108s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-quobyte-aed12416-c9a9-463b-8da6-afe9fc626254" released by "delete_volume" :: held 3.487s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Created reservations ['3f0b03be-5d52-449b-a010-d395276bfd69', '913d90ab-727b-491e-a275-5eecbc9fc00e', '26d6d1a2-449b-4402-8a70-e6a7548cfc68', '4b35e808-5e93-4909-a485-30671540bd0a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:05 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:09:05 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:06 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458" returned: 0 in 12.364s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6, size 1024.00 MB, duration 12.37 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:09:06 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Converted 1024.00 MB image at 82.81 MB/s Nov 03 17:09:06 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 is being set with open permissions: ugo+rw Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:06 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 Nov 03 17:09:06 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:06 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.780s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Deleted volume successfully. Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-23896792-fd94-472f-be52-df6888e19347 tempest-VolumesSnapshotListTestJSON-679480928 None] Lock "cinder-aed12416-c9a9-463b-8da6-afe9fc626254-delete_volume" released by "delete_volume" :: held 5.053s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:06 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458" returned: 0 in 0.566s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-quobyte-826ea65f-527c-4d4e-8432-ee6371673458" released by "_copy_volume_from_snapshot" :: held 14.802s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "cinder-quobyte-15315b03-7148-4a50-bc50-afadd40676bb" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-quobyte-15315b03-7148-4a50-bc50-afadd40676bb" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Deleting offline snapshot 15315b03-7148-4a50-bc50-afadd40676bb of volume fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] snapshot_file for this snap is: volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cacfd3-1bb9-44dd-a803-6f3b0d963e20]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:07 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb Nov 03 17:09:07 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:07 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb" returned: 0 in 0.688s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:07 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67ead7e-244d-46cd-b340-b5854465343d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:07 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 Nov 03 17:09:07 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:08 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" returned: 0 in 0.947s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:08 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb Nov 03 17:09:08 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:09 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb" returned: 0 in 0.501s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:09 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb Nov 03 17:09:09 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:09 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6.15315b03-7148-4a50-bc50-afadd40676bb" returned: 0 in 0.616s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-quobyte-15315b03-7148-4a50-bc50-afadd40676bb" released by "_delete_snapshot" :: held 2.958s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.071s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188c836-647d-4765-b2f0-68fe97e75bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826ea65f-527c-4d4e-8432-ee6371673458', 'volume_size': 2, 'source_volid': 'fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6', 'source_volstatus': 'available'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61aedb15-a04c-4c0e-bac5-fd700d74d886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Volume volume-826ea65f-527c-4d4e-8432-ee6371673458 (826ea65f-527c-4d4e-8432-ee6371673458): created successfully Nov 03 17:09:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61aedb15-a04c-4c0e-bac5-fd700d74d886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Flow 'volume_create_manager' (5ae75203-e45c-4a9e-bd07-ccdaa2738350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:10 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b9943fc4-333a-4459-b6cb-24d8c8a3c6e9 tempest-VolumesCloneTest-1031357823 None] Created volume successfully. Nov 03 17:09:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "cinder-826ea65f-527c-4d4e-8432-ee6371673458-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-826ea65f-527c-4d4e-8432-ee6371673458-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "cinder-quobyte-826ea65f-527c-4d4e-8432-ee6371673458" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-quobyte-826ea65f-527c-4d4e-8432-ee6371673458" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:11 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[3867195b-1fd4-4517-b636-a732677eec89]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:11 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 Nov 03 17:09:11 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:12 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458" returned: 0 in 0.761s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:12 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458 Nov 03 17:09:12 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:12 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-826ea65f-527c-4d4e-8432-ee6371673458" returned: 0 in 0.531s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-quobyte-826ea65f-527c-4d4e-8432-ee6371673458" released by "delete_volume" :: held 1.351s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Created reservations ['d2540230-e0c1-4d7d-919f-ec130a1b13b3', '71e6daf3-dfd6-43f9-bce6-994ee4d2264d', '3236ee79-20d5-471a-a7e8-f5350a866d30', '741214ca-33d0-4cc5-9a58-49f20750d828'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:12 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:09:12 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:13 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Deleted volume successfully. Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-abd6d184-5460-4119-9b86-1e4740ebe365 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-826ea65f-527c-4d4e-8432-ee6371673458-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "cinder-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=134,cinder:UPDATE=162,cinder:INSERT=48,cinder:DELETE=15 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Flow 'volume_create_manager' (93a5bbc1-72e1-411c-b9f1-8681aeaa5ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1995b7f8-bcee-4f2e-9090-bcd8624363d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1995b7f8-bcee-4f2e-9090-bcd8624363d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1104785522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb2a805-7927-4abf-a8f4-b647d6588e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf69563710847df8e64ff0c0439658d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:14Z,use_quota=True,user_id='f2aeda328df4495e873732eaae8161b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c75f99-8cc5-4309-ae13-a2f07d610513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c75f99-8cc5-4309-ae13-a2f07d610513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc1c02f-6299-48fe-a1a8-b561bc2c88d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc1c02f-6299-48fe-a1a8-b561bc2c88d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb2a805-7927-4abf-a8f4-b647d6588e9f', 'volume_name': 'volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f', 'volume_size': 2}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ec0ae3-d5ca-468e-9269-f7965abcb29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ec0ae3-d5ca-468e-9269-f7965abcb29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f26c5f7-effc-46b0-8dce-c365d3a14a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:13 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Volume bbb2a805-7927-4abf-a8f4-b647d6588e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f', 'volume_size': 2} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1104785522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb2a805-7927-4abf-a8f4-b647d6588e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf69563710847df8e64ff0c0439658d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:14Z,use_quota=True,user_id='f2aeda328df4495e873732eaae8161b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Creating volume bbb2a805-7927-4abf-a8f4-b647d6588e9f {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:09:13 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f 2147483648 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "cinder-quobyte-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:13 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f 2147483648 Nov 03 17:09:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-quobyte-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:13 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a93902-4476-49ce-a4e3-de35315954e4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:14 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 Nov 03 17:09:14 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:14 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" returned: 0 in 0.630s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:14 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6 Nov 03 17:09:14 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:14 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f 2147483648" returned: 0 in 0.857s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:14 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f Nov 03 17:09:14 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:14 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" returned: 0 in 0.339s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-quobyte-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6" released by "delete_volume" :: held 1.067s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Created reservations ['db31f7ac-b2e7-4d13-9e87-1fbc7b098ff9', '4ed07f2e-c8f6-48f5-b80f-ec410b8e40b7', '296bf97e-9864-4c0e-a0d4-460c16b5bb7a', 'b033f521-0fa8-4518-9973-1993ec4de7b7'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:15 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f" returned: 0 in 0.437s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:15 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:09:15 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f26c5f7-effc-46b0-8dce-c365d3a14a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f', 'volume_size': 2}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58da2d08-3132-4005-955b-8129a98b3c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:15 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Volume volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f (bbb2a805-7927-4abf-a8f4-b647d6588e9f): created successfully Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58da2d08-3132-4005-955b-8129a98b3c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Flow 'volume_create_manager' (93a5bbc1-72e1-411c-b9f1-8681aeaa5ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:15 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f464db10-1bc0-4e8b-ac25-3250cde968ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Created volume successfully. Nov 03 17:09:15 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.320s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:15 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Deleted volume successfully. Nov 03 17:09:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0cd6f618-3b84-4b24-9e4b-c0fab344f425 tempest-VolumesCloneTest-1031357823 None] Lock "cinder-fbb0dec6-399d-47ca-87f0-d1a1bc0d36f6-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Creating offline snapshot 719dd952-db55-4e16-8b84-b74ed5cc8339 of volume bbb2a805-7927-4abf-a8f4-b647d6588e9f {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:09:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d8482b-d27a-46ff-9142-7cd6dc6a62ca]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:16 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f Nov 03 17:09:16 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:16 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f" returned: 0 in 0.476s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 2G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:16 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 2G Nov 03 17:09:16 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:17 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 2G" returned: 0 in 0.564s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:17 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 Nov 03 17:09:17 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:17 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339" returned: 0 in 0.388s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:17 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 is being set with open permissions: ugo+rw Nov 03 17:09:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:17 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 Nov 03 17:09:17 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:17 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339" returned: 0 in 0.303s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:18 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.info Nov 03 17:09:18 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:18 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.info" returned: 0 in 0.301s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:18 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.info is being set with open permissions: ugo+rw Nov 03 17:09:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:18 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.info Nov 03 17:09:18 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:18 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.info" returned: 0 in 0.270s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-08116ebf-e96a-49cd-a785-62a919950d3b tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Create snapshot completed successfully Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "cinder-719dd952-db55-4e16-8b84-b74ed5cc8339-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-719dd952-db55-4e16-8b84-b74ed5cc8339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "cinder-quobyte-bbb2a805-7927-4abf-a8f4-b647d6588e9f" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-quobyte-bbb2a805-7927-4abf-a8f4-b647d6588e9f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "cinder-quobyte-719dd952-db55-4e16-8b84-b74ed5cc8339" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-quobyte-719dd952-db55-4e16-8b84-b74ed5cc8339" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Deleting offline snapshot 719dd952-db55-4e16-8b84-b74ed5cc8339 of volume bbb2a805-7927-4abf-a8f4-b647d6588e9f {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] snapshot_file for this snap is: volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a8199-2fe9-44cc-9641-6ffb72df34f3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:19 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 Nov 03 17:09:19 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:20 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339" returned: 0 in 0.430s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:20 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffab616e-896a-4167-b36f-a779dc670a82]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:20 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f Nov 03 17:09:20 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:20 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f" returned: 0 in 0.554s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:20 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 Nov 03 17:09:20 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:21 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339" returned: 0 in 0.514s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:21 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339 Nov 03 17:09:21 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Flow 'volume_create_manager' (65ba14f0-5464-4da1-909b-ca1f0f196161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd08302a-0d13-4045-8b80-e37b6fc19a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd08302a-0d13-4045-8b80-e37b6fc19a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-184512199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab09058-29e2-41db-a5ec-62e8941c1412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d04a5ce5230412c85c5adc87dbe11dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:21Z,use_quota=True,user_id='3e8638b86d8e4019b4398e6ba28a8903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8988691-51af-4b44-8701-29752ab8d48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8988691-51af-4b44-8701-29752ab8d48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c357789d-7baf-4373-8833-e32c7ca1eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:09:21 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f.719dd952-db55-4e16-8b84-b74ed5cc8339" returned: 0 in 0.295s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-quobyte-719dd952-db55-4e16-8b84-b74ed5cc8339" released by "_delete_snapshot" :: held 1.943s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-quobyte-bbb2a805-7927-4abf-a8f4-b647d6588e9f" released by "delete_snapshot" :: held 1.970s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Created reservations ['07d51160-9b83-4730-b575-194442bdf0db', '95e3eac7-ea12-474c-9580-07405616c258', '271f6dad-3211-4058-86e1-66fa7f69e7a9', '2a9af2db-08f3-4081-b37e-6688e630dbd8'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Delete snapshot completed successfully. Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-313fa60d-257b-4146-9533-5a35b2b936aa tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-719dd952-db55-4e16-8b84-b74ed5cc8339-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c357789d-7baf-4373-8833-e32c7ca1eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ab09058-29e2-41db-a5ec-62e8941c1412', 'volume_name': 'volume-0ab09058-29e2-41db-a5ec-62e8941c1412', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009810cb-0cbb-4758-a7d8-163c47151ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009810cb-0cbb-4758-a7d8-163c47151ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cba14f7-806d-4879-9450-d4c2c34b6319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:21 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Volume 0ab09058-29e2-41db-a5ec-62e8941c1412: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ab09058-29e2-41db-a5ec-62e8941c1412', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:09:21 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Trying to clone 0ab09058-29e2-41db-a5ec-62e8941c1412 from image d3081758-5b01-49fb-b109-4441003b66a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:09:22 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[689402ff-be29-4648-b402-bd9c1ed66f08]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:22 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD Nov 03 17:09:22 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:22 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 is fetched for user 3e8638b86d8e4019b4398e6ba28a8903. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bf4bff-b357-44d1-9867-961164750b43]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "cinder-bbb2a805-7927-4abf-a8f4-b647d6588e9f-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-bbb2a805-7927-4abf-a8f4-b647d6588e9f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "cinder-quobyte-bbb2a805-7927-4abf-a8f4-b647d6588e9f" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-quobyte-bbb2a805-7927-4abf-a8f4-b647d6588e9f" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:22 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD Nov 03 17:09:22 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa28706d-7084-4bf3-b83b-fae1da995705]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:23 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f Nov 03 17:09:23 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:23 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-184512199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab09058-29e2-41db-a5ec-62e8941c1412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d04a5ce5230412c85c5adc87dbe11dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:21Z,use_quota=True,user_id='3e8638b86d8e4019b4398e6ba28a8903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Creating volume 0ab09058-29e2-41db-a5ec-62e8941c1412 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:09:23 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:23 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 1073741824 Nov 03 17:09:23 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:23 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f" returned: 0 in 0.524s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:23 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f Nov 03 17:09:23 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:23 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bbb2a805-7927-4abf-a8f4-b647d6588e9f" returned: 0 in 0.314s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-quobyte-bbb2a805-7927-4abf-a8f4-b647d6588e9f" released by "delete_volume" :: held 0.955s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:23 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Created reservations ['381c42af-1050-4d53-a9db-b3fc6a144590', '763b0dbd-c3f5-4ab6-931d-9ec77688e3ec', '4958a8a0-4c2a-40f1-af48-f9959ec876d4', 'c0c7120a-d7ba-41ea-b78c-0b52d425bb4d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:24 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 1073741824" returned: 0 in 0.738s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:24 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:09:24 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:24 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 Nov 03 17:09:24 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:24 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.399s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Deleted volume successfully. Nov 03 17:09:24 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412" returned: 0 in 0.406s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Attempting download of d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume 0ab09058-29e2-41db-a5ec-62e8941c1412. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2f74b69-b111-4810-9119-e916fa3ba0ae tempest-VolumesSnapshotNegativeTestJSON-1789924806 None] Lock "cinder-bbb2a805-7927-4abf-a8f4-b647d6588e9f-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8e015-66f2-4f93-b4b5-3ef4262a0811]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8__t6f2d1t {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:24 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8__t6f2d1t Nov 03 17:09:24 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:25 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8__t6f2d1t" returned: 0 in 0.488s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8__t6f2d1t {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:25 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8__t6f2d1t Nov 03 17:09:25 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:25 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8__t6f2d1t" returned: 1 in 0.450s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3081758-5b01-49fb-b109-4441003b66a8__t6f2d1t' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:09:25 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9d5a5e-0b4c-481c-99a3-4b2eb18ac919]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:25 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD Nov 03 17:09:25 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:26 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:26 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] d3081758-5b01-49fb-b109-4441003b66a8 was qcow2, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:09:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:26 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 Nov 03 17:09:26 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:29 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412" returned: 0 in 2.876s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3081758-5b01-49fb-b109-4441003b66a8_rmssvbd9devstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:09:29 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Converted 112.00 MB image at 38.92 MB/s Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:29 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 1G Nov 03 17:09:29 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:29 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 1G" returned: 0 in 0.414s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Downloaded image d3081758-5b01-49fb-b109-4441003b66a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}])) to volume 0ab09058-29e2-41db-a5ec-62e8941c1412 successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Temporary image d3081758-5b01-49fb-b109-4441003b66a8 for user 3e8638b86d8e4019b4398e6ba28a8903 is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Marking volume 0ab09058-29e2-41db-a5ec-62e8941c1412 as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Copying metadata from image d3081758-5b01-49fb-b109-4441003b66a8 to 0ab09058-29e2-41db-a5ec-62e8941c1412. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Creating volume glance metadata for volume 0ab09058-29e2-41db-a5ec-62e8941c1412 backed by image d3081758-5b01-49fb-b109-4441003b66a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cba14f7-806d-4879-9450-d4c2c34b6319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab09058-29e2-41db-a5ec-62e8941c1412', 'volume_size': 1, 'image_id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3081758-5b01-49fb-b109-4441003b66a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'afe345e3326845a8a8da4e318cc9147e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3081758-5b01-49fb-b109-4441003b66a8', 'created_at': datetime.datetime(2026, 11, 3, 15, 48, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3081758-5b01-49fb-b109-4441003b66a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284e8ac9-b7ac-4780-825c-75c23f23b87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:29 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Volume volume-0ab09058-29e2-41db-a5ec-62e8941c1412 (0ab09058-29e2-41db-a5ec-62e8941c1412): created successfully Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284e8ac9-b7ac-4780-825c-75c23f23b87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Flow 'volume_create_manager' (65ba14f0-5464-4da1-909b-ca1f0f196161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-272e77de-c46d-4c50-945f-57b4ad17a9e1 tempest-VolumesExtendTest-786562221 None] Created volume successfully. Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74ce26f1-16f7-4ee8-9a03-cf72a1242779 tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74ce26f1-16f7-4ee8-9a03-cf72a1242779 tempest-VolumesExtendTest-786562221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[198ba45a-6e34-44c8-b4c4-ba1b7f6cfcb2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74ce26f1-16f7-4ee8-9a03-cf72a1242779 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:30 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 Nov 03 17:09:30 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:30 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74ce26f1-16f7-4ee8-9a03-cf72a1242779 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412" returned: 0 in 0.444s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74ce26f1-16f7-4ee8-9a03-cf72a1242779 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 2G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74ce26f1-16f7-4ee8-9a03-cf72a1242779 tempest-VolumesExtendTest-786562221 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 2G" returned: 0 in 0.148s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74ce26f1-16f7-4ee8-9a03-cf72a1242779 tempest-VolumesExtendTest-786562221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.632s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:30 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-74ce26f1-16f7-4ee8-9a03-cf72a1242779 tempest-VolumesExtendTest-786562221 None] Extend volume completed successfully. Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:09:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:09:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Acquiring lock "cinder-0ab09058-29e2-41db-a5ec-62e8941c1412-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Lock "cinder-0ab09058-29e2-41db-a5ec-62e8941c1412-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Acquiring lock "cinder-quobyte-0ab09058-29e2-41db-a5ec-62e8941c1412" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Lock "cinder-quobyte-0ab09058-29e2-41db-a5ec-62e8941c1412" acquired by "delete_volume" :: waited 0.040s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:31 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd27cd0-bee8-489c-9ad2-dbd570a05ca9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:32 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 Nov 03 17:09:32 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:32 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412" returned: 0 in 0.435s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:32 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412 Nov 03 17:09:32 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:32 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-0ab09058-29e2-41db-a5ec-62e8941c1412" returned: 0 in 0.384s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Lock "cinder-quobyte-0ab09058-29e2-41db-a5ec-62e8941c1412" released by "delete_volume" :: held 0.877s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:32 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Created reservations ['01ff87d1-ac44-4a59-84f6-bb6ac6ee46cf', '708d58b9-1216-4c9f-8f69-8139f9ff0cee', '7cb0e990-3d8b-41a8-aa35-8f70dceda307', '82c02a1d-bdec-4569-bdc2-a052a4fb82af'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:33 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:09:33 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:33 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.395s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Deleted volume successfully. Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c3d6894d-93b9-4a5f-9843-7a0ffd6546b8 tempest-VolumesExtendTest-786562221 None] Lock "cinder-0ab09058-29e2-41db-a5ec-62e8941c1412-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Flow 'volume_create_manager' (8c642902-1f1d-49be-b7af-bb7d89fb0c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f068693-9b34-4a6e-9e84-5272ef6cd169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f068693-9b34-4a6e-9e84-5272ef6cd169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-598229187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d04a5ce5230412c85c5adc87dbe11dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:34Z,use_quota=True,user_id='3e8638b86d8e4019b4398e6ba28a8903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c6b091-7f6d-487d-80ed-b5814ddb3e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c6b091-7f6d-487d-80ed-b5814ddb3e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159178cf-b78c-4c42-aaaf-0c94c701ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159178cf-b78c-4c42-aaaf-0c94c701ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9', 'volume_name': 'volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368b5fd2-74c2-4bee-820c-cbdc74ec9d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368b5fd2-74c2-4bee-820c-cbdc74ec9d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28df095-373a-4aef-b3fd-84875ebc026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:33 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Volume e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9', 'volume_size': 1} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-598229187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d04a5ce5230412c85c5adc87dbe11dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:34Z,use_quota=True,user_id='3e8638b86d8e4019b4398e6ba28a8903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Creating volume e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:09:33 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:09:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:34 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 1073741824 Nov 03 17:09:34 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Flow 'volume_create_manager' (3e520ad5-65d8-4327-8f66-c9e4902871ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163a909b-1b6b-46f6-b5bd-410e0c4f06c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163a909b-1b6b-46f6-b5bd-410e0c4f06c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1645234403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b098625-ada4-49ea-956d-bff5df0b8fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475381c1817a487194953ab6aaa25403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:34Z,use_quota=True,user_id='987d84c8c20841c4b262868a0be0e994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b46722-3e78-424a-81a7-44669522a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b46722-3e78-424a-81a7-44669522a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3740a11a-0c76-432e-a2fe-275c5d2a13d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3740a11a-0c76-432e-a2fe-275c5d2a13d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b098625-ada4-49ea-956d-bff5df0b8fbd', 'volume_name': 'volume-3b098625-ada4-49ea-956d-bff5df0b8fbd', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895ad739-c254-4413-a643-c58446efe94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895ad739-c254-4413-a643-c58446efe94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7720c7-9663-4e4c-82b8-a3b3fde80521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:34 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Volume 3b098625-ada4-49ea-956d-bff5df0b8fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b098625-ada4-49ea-956d-bff5df0b8fbd', 'volume_size': 1} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:34 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 1073741824" returned: 0 in 0.702s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:34 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 Nov 03 17:09:34 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:35 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" returned: 0 in 0.293s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1645234403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b098625-ada4-49ea-956d-bff5df0b8fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475381c1817a487194953ab6aaa25403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:34Z,use_quota=True,user_id='987d84c8c20841c4b262868a0be0e994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Creating volume 3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:09:35 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28df095-373a-4aef-b3fd-84875ebc026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbac03a-9de0-44b0-b943-d19a916f2733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:35 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd 1073741824 Nov 03 17:09:35 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:35 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Volume volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 (e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9): created successfully Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbac03a-9de0-44b0-b943-d19a916f2733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Flow 'volume_create_manager' (8c642902-1f1d-49be-b7af-bb7d89fb0c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:35 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8b2bd962-2c92-4831-adc1-b9957b65ba3e tempest-VolumesExtendTest-786562221 None] Created volume successfully. Nov 03 17:09:35 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd 1073741824" returned: 0 in 0.669s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:35 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd Nov 03 17:09:35 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:36 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd" returned: 0 in 0.324s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7720c7-9663-4e4c-82b8-a3b3fde80521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b098625-ada4-49ea-956d-bff5df0b8fbd', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d39fbb-a7d0-4910-99b1-1414402bc985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:36 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Volume volume-3b098625-ada4-49ea-956d-bff5df0b8fbd (3b098625-ada4-49ea-956d-bff5df0b8fbd): created successfully Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d39fbb-a7d0-4910-99b1-1414402bc985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Flow 'volume_create_manager' (3e520ad5-65d8-4327-8f66-c9e4902871ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c0cd2b6c-1beb-4acb-b698-c9d74c236bc5 tempest-SnapshotDependencyTests-1954851977 None] Created volume successfully. Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Creating offline snapshot afce0cff-a626-47f0-9dd1-b0a53a561af3 of volume e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b06a3d-60bc-4cad-b66c-e3b6c9431db6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:36 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 Nov 03 17:09:36 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-8497c082-f142-4a75-a3dd-2df64677988a req-9fb8a165-ae92-4759-a0b4-e0c6e2ea123e tempest-TestShelveInstance-2028148084 None] Terminate volume connection completed successfully. Nov 03 17:09:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-8497c082-f142-4a75-a3dd-2df64677988a req-9fb8a165-ae92-4759-a0b4-e0c6e2ea123e tempest-TestShelveInstance-2028148084 None] Deleting attachment bc03ddb8-d3d0-49b5-bfc2-a1264810c9c3. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:09:37 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" returned: 0 in 0.532s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:37 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 1G Nov 03 17:09:37 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:37 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 1G" returned: 0 in 0.524s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:37 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 Nov 03 17:09:37 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:37 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3" returned: 0 in 0.340s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:37 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 is being set with open permissions: ugo+rw Nov 03 17:09:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:37 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 Nov 03 17:09:37 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:38 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3" returned: 0 in 0.279s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:38 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.info Nov 03 17:09:38 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:38 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.info" returned: 0 in 0.314s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:38 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.info is being set with open permissions: ugo+rw Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:38 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.info Nov 03 17:09:38 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:38 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.info" returned: 0 in 0.376s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.890s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Creating offline snapshot 364c8d9e-087a-45c8-84e4-180b32a0c2f2 of volume 3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:09:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8f7353d7-5968-4955-8593-2802fe00680f tempest-VolumesExtendTest-786562221 None] Create snapshot completed successfully Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e1caeb-a67d-4d51-986f-50bbca611dc0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:39 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd Nov 03 17:09:39 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:39 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd" returned: 0 in 0.494s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:39 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 1G Nov 03 17:09:39 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-97821ef2-eb14-47ef-b442-d101c1cf32b1 req-2e538d4d-5b70-4be6-b178-ed6d97e40e7b tempest-TestShelveInstance-2028148084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d07858c9-a89b-4b81-9828-e17c53ea4e9a tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:40 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 1G" returned: 0 in 0.647s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b098625-ada4-49ea-956d-bff5df0b8fbd -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:40 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b098625-ada4-49ea-956d-bff5df0b8fbd -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 Nov 03 17:09:40 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:40 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b098625-ada4-49ea-956d-bff5df0b8fbd -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2" returned: 0 in 0.319s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:40 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 is being set with open permissions: ugo+rw Nov 03 17:09:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:40 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 Nov 03 17:09:40 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:40 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2" returned: 0 in 0.310s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:40 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.info Nov 03 17:09:40 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:41 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.info" returned: 0 in 0.389s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:41 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.info is being set with open permissions: ugo+rw Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:41 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.info Nov 03 17:09:41 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:41 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.info" returned: 0 in 0.314s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-97821ef2-eb14-47ef-b442-d101c1cf32b1 req-2e538d4d-5b70-4be6-b178-ed6d97e40e7b tempest-TestShelveInstance-2028148084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.908s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-97821ef2-eb14-47ef-b442-d101c1cf32b1 req-2e538d4d-5b70-4be6-b178-ed6d97e40e7b tempest-TestShelveInstance-2028148084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d07858c9-a89b-4b81-9828-e17c53ea4e9a tempest-VolumesExtendTest-786562221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.793s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-79505655-43ac-494c-a7f3-315e4408bec2 tempest-SnapshotDependencyTests-1954851977 None] Create snapshot completed successfully Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[05756f5d-1afb-48dd-af7a-4c7f934efa1f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d07858c9-a89b-4b81-9828-e17c53ea4e9a tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:41 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-97821ef2-eb14-47ef-b442-d101c1cf32b1 req-2e538d4d-5b70-4be6-b178-ed6d97e40e7b tempest-TestShelveInstance-2028148084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-ce48c9ae-f367-457c-9667-1f88c4ab5666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6ccfbe9-4ebf-4db0-8b33-7d46901c45a9', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:09:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-97821ef2-eb14-47ef-b442-d101c1cf32b1 req-2e538d4d-5b70-4be6-b178-ed6d97e40e7b tempest-TestShelveInstance-2028148084 None] attachment_update completed successfully. Nov 03 17:09:41 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 Nov 03 17:09:41 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:42 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d07858c9-a89b-4b81-9828-e17c53ea4e9a tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" returned: 0 in 0.580s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d07858c9-a89b-4b81-9828-e17c53ea4e9a tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 2G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d07858c9-a89b-4b81-9828-e17c53ea4e9a tempest-VolumesExtendTest-786562221 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 2G" returned: 0 in 0.232s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d07858c9-a89b-4b81-9828-e17c53ea4e9a tempest-VolumesExtendTest-786562221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.914s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d07858c9-a89b-4b81-9828-e17c53ea4e9a tempest-VolumesExtendTest-786562221 None] Extend volume completed successfully. Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Flow 'volume_create_manager' (b1b2ee5f-78b4-42ff-9545-9b48ea68bde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb11a88-e217-437c-9b10-7238df4533cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb11a88-e217-437c-9b10-7238df4533cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9361002f-c904-4621-bf3c-1da3de53372a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475381c1817a487194953ab6aaa25403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=364c8d9e-087a-45c8-84e4-180b32a0c2f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:43Z,use_quota=True,user_id='987d84c8c20841c4b262868a0be0e994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39bbd94-3b2a-41a0-a27e-cb0650ccb434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39bbd94-3b2a-41a0-a27e-cb0650ccb434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2cc604-e78a-4735-8b95-5c8c5014cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2cc604-e78a-4735-8b95-5c8c5014cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9361002f-c904-4621-bf3c-1da3de53372a', 'volume_name': 'volume-9361002f-c904-4621-bf3c-1da3de53372a', 'volume_size': 1, 'snapshot_id': '364c8d9e-087a-45c8-84e4-180b32a0c2f2'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc87812-6a36-4839-9717-fbb08953ccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc87812-6a36-4839-9717-fbb08953ccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab094b36-8343-4b62-a377-be02046bb8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:43 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Volume 9361002f-c904-4621-bf3c-1da3de53372a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9361002f-c904-4621-bf3c-1da3de53372a', 'volume_size': 1, 'snapshot_id': '364c8d9e-087a-45c8-84e4-180b32a0c2f2'} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-quobyte-364c8d9e-087a-45c8-84e4-180b32a0c2f2-9361002f-c904-4621-bf3c-1da3de53372a" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Acquiring lock "cinder-afce0cff-a626-47f0-9dd1-b0a53a561af3-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-364c8d9e-087a-45c8-84e4-180b32a0c2f2-9361002f-c904-4621-bf3c-1da3de53372a" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Creating volume 9361002f-c904-4621-bf3c-1da3de53372a from snapshot 364c8d9e-087a-45c8-84e4-180b32a0c2f2 {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-quobyte-9361002f-c904-4621-bf3c-1da3de53372a" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Lock "cinder-afce0cff-a626-47f0-9dd1-b0a53a561af3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Acquiring lock "cinder-quobyte-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-9361002f-c904-4621-bf3c-1da3de53372a" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] snapshot: 364c8d9e-087a-45c8-84e4-180b32a0c2f2, volume: 9361002f-c904-4621-bf3c-1da3de53372a, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Lock "cinder-quobyte-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Acquiring lock "cinder-quobyte-afce0cff-a626-47f0-9dd1-b0a53a561af3" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b08e6a-1a2f-421d-ba92-1ae89a5ed5d7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Lock "cinder-quobyte-afce0cff-a626-47f0-9dd1-b0a53a561af3" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Deleting offline snapshot afce0cff-a626-47f0-9dd1-b0a53a561af3 of volume e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] snapshot_file for this snap is: volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4cf27e-d681-4dc4-8fe7-6ab72731a523]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:43 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 Nov 03 17:09:43 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:43 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 Nov 03 17:09:43 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:43 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3" returned: 0 in 0.497s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:43 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2" returned: 0 in 0.648s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b098625-ada4-49ea-956d-bff5df0b8fbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff6a12-71b0-43d1-a078-a730f0362eef]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1909a6a1-531c-4674-817a-28512d6b0a87]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:44 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 Nov 03 17:09:44 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:44 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd Nov 03 17:09:44 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:44 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" returned: 0 in 0.559s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:44 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 Nov 03 17:09:44 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:44 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd" returned: 0 in 0.795s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:09:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:44 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a Nov 03 17:09:44 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:45 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3" returned: 0 in 0.564s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:45 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3 Nov 03 17:09:45 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:45 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9.afce0cff-a626-47f0-9dd1-b0a53a561af3" returned: 0 in 0.340s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Lock "cinder-quobyte-afce0cff-a626-47f0-9dd1-b0a53a561af3" released by "_delete_snapshot" :: held 2.215s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Lock "cinder-quobyte-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" released by "delete_snapshot" :: held 2.266s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:45 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Created reservations ['52e5910a-f40b-4fad-9877-6923c044976d', '83ff6229-c3e6-45ab-a79c-39fd72259325', '55c9d737-3f6d-4655-b464-7f61e993202f', '159bd644-c192-49e4-854b-80a738587f58'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Delete snapshot completed successfully. Nov 03 17:09:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3aae5cdc-4fd1-4e37-b309-c9130f164b13 tempest-VolumesExtendTest-786562221 None] Lock "cinder-afce0cff-a626-47f0-9dd1-b0a53a561af3-delete_snapshot" released by "delete_snapshot" :: held 2.630s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Acquiring lock "cinder-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Lock "cinder-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Acquiring lock "cinder-quobyte-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Lock "cinder-quobyte-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" acquired by "delete_volume" :: waited 0.037s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c654e42e-1805-4c8a-838e-fde78db23145]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:47 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 Nov 03 17:09:47 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:48 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" returned: 0 in 1.415s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:48 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9 Nov 03 17:09:48 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:49 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" returned: 0 in 0.580s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Lock "cinder-quobyte-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9" released by "delete_volume" :: held 2.251s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Created reservations ['adf8b669-df93-4ec4-b833-9950cf3c2400', '65de4a0d-09c0-402f-94cb-be83c0d20bb3', '9a10e7b1-7612-460e-af6f-1b780d700cfa', '84e30791-d5c6-4e98-a0d2-d1c35f39c6b9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:49 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:09:49 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:49 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.493s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:49 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Deleted volume successfully. Nov 03 17:09:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64049c3a-5058-4273-9d57-ad35b22ac24a tempest-VolumesExtendTest-786562221 None] Lock "cinder-e9b6f9c3-ecdd-46d2-b1f6-64da14a3def9-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:56 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a" returned: 0 in 11.988s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:56 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd, size 1024.00 MB, duration 11.99 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:09:56 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Converted 1024.00 MB image at 85.41 MB/s Nov 03 17:09:56 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a is being set with open permissions: ugo+rw Nov 03 17:09:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:56 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a Nov 03 17:09:56 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:57 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a" returned: 0 in 0.466s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-9361002f-c904-4621-bf3c-1da3de53372a" released by "_copy_volume_from_snapshot" :: held 14.048s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-364c8d9e-087a-45c8-84e4-180b32a0c2f2-9361002f-c904-4621-bf3c-1da3de53372a" released by "_create_volume_from_snapshot" :: held 14.175s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.221s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab094b36-8343-4b62-a377-be02046bb8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9361002f-c904-4621-bf3c-1da3de53372a', 'volume_size': 1, 'snapshot_id': '364c8d9e-087a-45c8-84e4-180b32a0c2f2'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e47e04-2cfd-4ce2-8345-f7e522a34c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:57 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Volume volume-9361002f-c904-4621-bf3c-1da3de53372a (9361002f-c904-4621-bf3c-1da3de53372a): created successfully Nov 03 17:09:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e47e04-2cfd-4ce2-8345-f7e522a34c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Flow 'volume_create_manager' (b1b2ee5f-78b4-42ff-9545-9b48ea68bde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-acb8770a-5d8f-4321-8caf-830aa1d7f363 tempest-SnapshotDependencyTests-1954851977 None] Created volume successfully. Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-364c8d9e-087a-45c8-84e4-180b32a0c2f2-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-364c8d9e-087a-45c8-84e4-180b32a0c2f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-quobyte-3b098625-ada4-49ea-956d-bff5df0b8fbd" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-3b098625-ada4-49ea-956d-bff5df0b8fbd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-quobyte-364c8d9e-087a-45c8-84e4-180b32a0c2f2" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-364c8d9e-087a-45c8-84e4-180b32a0c2f2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Deleting offline snapshot 364c8d9e-087a-45c8-84e4-180b32a0c2f2 of volume 3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] snapshot_file for this snap is: volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f57945b-305a-436c-b03a-14e60454e602]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:58 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 Nov 03 17:09:58 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:59 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2" returned: 0 in 0.729s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b098625-ada4-49ea-956d-bff5df0b8fbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:59 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd1b1cf-dbd3-47a3-97fa-9fed08ac3a33]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:59 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd Nov 03 17:09:59 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:00 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd" returned: 0 in 0.791s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:00 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 Nov 03 17:10:00 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:00 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2" returned: 0 in 0.565s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:00 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2 Nov 03 17:10:00 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:01 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd.364c8d9e-087a-45c8-84e4-180b32a0c2f2" returned: 0 in 0.387s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=85,cinder:INSERT=27,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-364c8d9e-087a-45c8-84e4-180b32a0c2f2" released by "_delete_snapshot" :: held 2.667s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-3b098625-ada4-49ea-956d-bff5df0b8fbd" released by "delete_snapshot" :: held 2.706s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Created reservations ['4119e322-a748-4629-8f9c-e82d6b9aba60', '3be857e3-2dcd-4907-8742-13a7ee7a0da3', '91d8ed71-7e76-4a28-aa2b-599d928344fa', '060df7f1-0542-4ebf-8798-74db989f8264'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Delete snapshot completed successfully. Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a4ae1d8e-8a62-48aa-a84b-6dbb12eb86ee tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-364c8d9e-087a-45c8-84e4-180b32a0c2f2-delete_snapshot" released by "delete_snapshot" :: held 3.009s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-3b098625-ada4-49ea-956d-bff5df0b8fbd-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-3b098625-ada4-49ea-956d-bff5df0b8fbd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-quobyte-3b098625-ada4-49ea-956d-bff5df0b8fbd" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-3b098625-ada4-49ea-956d-bff5df0b8fbd" acquired by "delete_volume" :: waited 0.035s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[319a4d0a-5f01-4390-a70a-ab55fb2e5526]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:02 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd Nov 03 17:10:02 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:02 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd" returned: 0 in 0.489s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:02 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd Nov 03 17:10:02 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:03 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3b098625-ada4-49ea-956d-bff5df0b8fbd" returned: 0 in 0.594s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-3b098625-ada4-49ea-956d-bff5df0b8fbd" released by "delete_volume" :: held 1.206s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Created reservations ['e725cc61-34f5-4c13-ac24-05afa3a22ff3', '7fb28634-3b05-4eff-a277-2124c4b3f8d4', '0c3ebfc4-e40f-4341-bef4-d23abe112cb6', '6aa7fbb3-727e-43d4-9760-b8bc61988a7d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:03 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:10:03 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:03 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.419s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:03 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Deleted volume successfully. Nov 03 17:10:03 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d29e2a1c-0159-4808-bff7-fb4e29cfd612 tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-3b098625-ada4-49ea-956d-bff5df0b8fbd-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-9361002f-c904-4621-bf3c-1da3de53372a-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-9361002f-c904-4621-bf3c-1da3de53372a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "cinder-quobyte-9361002f-c904-4621-bf3c-1da3de53372a" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-9361002f-c904-4621-bf3c-1da3de53372a" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e226983-c78a-44f7-918b-0a1278c367f2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:04 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a Nov 03 17:10:04 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:04 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a" returned: 0 in 0.476s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:04 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a Nov 03 17:10:04 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:05 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9361002f-c904-4621-bf3c-1da3de53372a" returned: 0 in 0.370s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-quobyte-9361002f-c904-4621-bf3c-1da3de53372a" released by "delete_volume" :: held 0.918s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Created reservations ['bce07a87-2050-4bb2-b608-02b76b87c9f0', 'dcb38517-f4d4-4868-b078-d497503c514e', '8486a124-b3ac-4ae5-a461-2fa2f7ab3d82', '416d7ea1-dec4-4da6-a504-05b7b524d276'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:05 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:10:05 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Flow 'volume_create_manager' (1aece6df-b576-424f-8876-3512ed4fff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d93e2a-199a-4891-87b0-8fa410765dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d93e2a-199a-4891-87b0-8fa410765dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-719569855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b20fc-97ae-4144-9c83-9c7900090613,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b06ca3b110945e0a1e4065beaa9e41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:06Z,use_quota=True,user_id='8610e6d943ac4b4a8b2b034ffd158ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d180ada6-9562-4f3c-b5b8-45e38002bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d180ada6-9562-4f3c-b5b8-45e38002bf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c9035f-9127-4e60-a5ab-a886e16df98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c9035f-9127-4e60-a5ab-a886e16df98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7b20fc-97ae-4144-9c83-9c7900090613', 'volume_name': 'volume-9b7b20fc-97ae-4144-9c83-9c7900090613', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184eb746-0fda-482a-b96c-b5cf2cd88057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184eb746-0fda-482a-b96c-b5cf2cd88057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811c63cd-b5a5-42c7-8445-65693fe7788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:06 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Volume 9b7b20fc-97ae-4144-9c83-9c7900090613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7b20fc-97ae-4144-9c83-9c7900090613', 'volume_size': 1} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-719569855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b20fc-97ae-4144-9c83-9c7900090613,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b06ca3b110945e0a1e4065beaa9e41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:06Z,use_quota=True,user_id='8610e6d943ac4b4a8b2b034ffd158ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Creating volume 9b7b20fc-97ae-4144-9c83-9c7900090613 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:06 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:06 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.456s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Deleted volume successfully. Nov 03 17:10:06 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 1073741824 Nov 03 17:10:06 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-eee615ef-c7da-41e0-bc9d-1cfc54be43fd tempest-SnapshotDependencyTests-1954851977 None] Lock "cinder-9361002f-c904-4621-bf3c-1da3de53372a-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:06 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 1073741824" returned: 0 in 0.686s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:06 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 Nov 03 17:10:06 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Flow 'volume_create_manager' (7517620b-6803-4646-96f2-8754389d68d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f228f9-511b-487e-9a98-8b5a3ef1135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f228f9-511b-487e-9a98-8b5a3ef1135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1799248617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25eea61d-1d78-41ed-aeb3-2d455aaa21bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6379e084e6424a0f8e1bf1d748a79ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:07Z,use_quota=True,user_id='c65119c1a56845428fc60c7f4917e226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6b5ce4-855d-4383-b387-dbcd4162d495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6b5ce4-855d-4383-b387-dbcd4162d495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b86fe0-36d5-4ed3-b437-e8ee604aa745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b86fe0-36d5-4ed3-b437-e8ee604aa745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25eea61d-1d78-41ed-aeb3-2d455aaa21bc', 'volume_name': 'volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e773c6-aa42-4d88-9a3e-9ad6e7537e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e773c6-aa42-4d88-9a3e-9ad6e7537e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efa6ce5-af07-4f57-923f-5adaa3c1f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Volume 25eea61d-1d78-41ed-aeb3-2d455aaa21bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc', 'volume_size': 1} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:07 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613" returned: 0 in 0.570s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1799248617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25eea61d-1d78-41ed-aeb3-2d455aaa21bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6379e084e6424a0f8e1bf1d748a79ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:07Z,use_quota=True,user_id='c65119c1a56845428fc60c7f4917e226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Creating volume 25eea61d-1d78-41ed-aeb3-2d455aaa21bc {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:07 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811c63cd-b5a5-42c7-8445-65693fe7788e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7b20fc-97ae-4144-9c83-9c7900090613', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc 1073741824 Nov 03 17:10:07 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2227c577-59eb-4ffb-9ea1-6e9ba8c9c821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Volume volume-9b7b20fc-97ae-4144-9c83-9c7900090613 (9b7b20fc-97ae-4144-9c83-9c7900090613): created successfully Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2227c577-59eb-4ffb-9ea1-6e9ba8c9c821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Flow 'volume_create_manager' (1aece6df-b576-424f-8876-3512ed4fff0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2204fddd-9ffd-4bc5-9aff-5c7afafefd31 tempest-VolumesListTestJSON-1673130132 None] Created volume successfully. Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Flow 'volume_create_manager' (f64a9b71-0b3d-4464-a455-fa4debb10bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165ae47c-19fa-4146-a6ec-524b2a11356e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165ae47c-19fa-4146-a6ec-524b2a11356e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-375053871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b798031c-f1a2-4dde-b4b6-784b07d22f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6379e084e6424a0f8e1bf1d748a79ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:08Z,use_quota=True,user_id='c65119c1a56845428fc60c7f4917e226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e96d2dd-8fbf-44cf-944c-fb983c138406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e96d2dd-8fbf-44cf-944c-fb983c138406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5687776f-f576-45c5-940f-92c07ab41085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5687776f-f576-45c5-940f-92c07ab41085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b798031c-f1a2-4dde-b4b6-784b07d22f14', 'volume_name': 'volume-b798031c-f1a2-4dde-b4b6-784b07d22f14', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91dea55-34c3-406e-b090-12ff9380f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91dea55-34c3-406e-b090-12ff9380f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7f75f3-a77f-4425-a132-dc817e412bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Volume b798031c-f1a2-4dde-b4b6-784b07d22f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b798031c-f1a2-4dde-b4b6-784b07d22f14', 'volume_size': 1} Nov 03 17:10:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:08 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc 1073741824" returned: 0 in 0.882s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:08 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc Nov 03 17:10:08 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:08 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc" returned: 0 in 0.454s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.141s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-375053871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b798031c-f1a2-4dde-b4b6-784b07d22f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6379e084e6424a0f8e1bf1d748a79ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:08Z,use_quota=True,user_id='c65119c1a56845428fc60c7f4917e226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Creating volume b798031c-f1a2-4dde-b4b6-784b07d22f14 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:08 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efa6ce5-af07-4f57-923f-5adaa3c1f334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:08 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 1073741824 Nov 03 17:10:08 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724fe557-ff51-4b34-a6d1-0ffaf65ac72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:08 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Volume volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc (25eea61d-1d78-41ed-aeb3-2d455aaa21bc): created successfully Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724fe557-ff51-4b34-a6d1-0ffaf65ac72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Flow 'volume_create_manager' (7517620b-6803-4646-96f2-8754389d68d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5969b072-66cc-4701-ac26-6657ced8185e tempest-TestServerVolumeAttachmentScenario-1360908729 None] Created volume successfully. Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Flow 'volume_create_manager' (5ccc4c60-5317-428c-9039-08beea675e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21a326e-85da-4c94-8776-b79f9d29169b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21a326e-85da-4c94-8776-b79f9d29169b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2055309472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c595389-6439-479d-984d-ace1d38ac09b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b06ca3b110945e0a1e4065beaa9e41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:09Z,use_quota=True,user_id='8610e6d943ac4b4a8b2b034ffd158ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7317939-9b4b-419a-941b-cd18f3753f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7317939-9b4b-419a-941b-cd18f3753f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647a8cb8-9a80-471c-b7d9-915191556820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647a8cb8-9a80-471c-b7d9-915191556820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c595389-6439-479d-984d-ace1d38ac09b', 'volume_name': 'volume-1c595389-6439-479d-984d-ace1d38ac09b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d1bbe5-f284-426a-bccb-141a5b867e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d1bbe5-f284-426a-bccb-141a5b867e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768ae1fd-dc02-4913-b0ed-14c6e8872838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:09 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Volume 1c595389-6439-479d-984d-ace1d38ac09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c595389-6439-479d-984d-ace1d38ac09b', 'volume_size': 1} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:09 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 1073741824" returned: 0 in 0.758s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:09 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 Nov 03 17:10:09 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:09 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14" returned: 0 in 0.284s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2055309472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c595389-6439-479d-984d-ace1d38ac09b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b06ca3b110945e0a1e4065beaa9e41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:09Z,use_quota=True,user_id='8610e6d943ac4b4a8b2b034ffd158ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Creating volume 1c595389-6439-479d-984d-ace1d38ac09b {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:09 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:10:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7f75f3-a77f-4425-a132-dc817e412bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b798031c-f1a2-4dde-b4b6-784b07d22f14', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:10 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b 1073741824 Nov 03 17:10:10 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8040eee9-4826-4c32-803e-663534e1c8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Volume volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 (b798031c-f1a2-4dde-b4b6-784b07d22f14): created successfully Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8040eee9-4826-4c32-803e-663534e1c8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Flow 'volume_create_manager' (f64a9b71-0b3d-4464-a455-fa4debb10bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:10 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-74d76845-5a97-46f3-a45b-5dc26709dc7a tempest-TestServerVolumeAttachmentScenario-1360908729 None] Created volume successfully. Nov 03 17:10:10 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b 1073741824" returned: 0 in 0.642s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:10 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b Nov 03 17:10:10 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:10 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b" returned: 0 in 0.281s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768ae1fd-dc02-4913-b0ed-14c6e8872838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c595389-6439-479d-984d-ace1d38ac09b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ccc843-7985-4111-b6dc-89a168bf4a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Volume volume-1c595389-6439-479d-984d-ace1d38ac09b (1c595389-6439-479d-984d-ace1d38ac09b): created successfully Nov 03 17:10:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ccc843-7985-4111-b6dc-89a168bf4a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Flow 'volume_create_manager' (5ccc4c60-5317-428c-9039-08beea675e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cb4b7ce7-b41a-423f-810e-910275e9f313 tempest-VolumesListTestJSON-1673130132 None] Created volume successfully. Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Flow 'volume_create_manager' (0429d8fa-274f-472c-8b32-95822fe01fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0206ef3-492a-4d40-b75c-703da347d737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0206ef3-492a-4d40-b75c-703da347d737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1418943526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b06ca3b110945e0a1e4065beaa9e41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:13Z,use_quota=True,user_id='8610e6d943ac4b4a8b2b034ffd158ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c1e9af-f277-41da-aea6-114014b06455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c1e9af-f277-41da-aea6-114014b06455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b706dfe-813d-4dfd-a4d9-e1ce09bd296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b706dfe-813d-4dfd-a4d9-e1ce09bd296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b', 'volume_name': 'volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9eefb5-41d3-44aa-a416-46d139064769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9eefb5-41d3-44aa-a416-46d139064769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d3f7e4-370e-4cec-b3b3-c86ee8200e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:13 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Volume 9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b', 'volume_size': 1} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1418943526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b06ca3b110945e0a1e4065beaa9e41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:13Z,use_quota=True,user_id='8610e6d943ac4b4a8b2b034ffd158ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Creating volume 9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:13 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:13 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b 1073741824 Nov 03 17:10:13 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b 1073741824" returned: 0 in 0.706s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:13 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:13 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b Nov 03 17:10:13 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:14 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b" returned: 0 in 0.434s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:14 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=108,cinder:SELECT=96,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:10:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d3f7e4-370e-4cec-b3b3-c86ee8200e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c389144e-2b43-4482-a61f-d4dc9ac59800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:14 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Volume volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b (9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b): created successfully Nov 03 17:10:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c389144e-2b43-4482-a61f-d4dc9ac59800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:14 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Flow 'volume_create_manager' (0429d8fa-274f-472c-8b32-95822fe01fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:14 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a810f11a-5d33-4cd6-92ca-c9fe3db4e13b tempest-VolumesListTestJSON-1673130132 None] Created volume successfully. Nov 03 17:10:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "cinder-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "cinder-quobyte-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-quobyte-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:18 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[da44b363-47cf-4452-af22-87ac758a27e1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:18 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b Nov 03 17:10:18 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:19 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b" returned: 0 in 0.511s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:19 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b Nov 03 17:10:19 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:19 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b" returned: 0 in 0.331s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-quobyte-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b" released by "delete_volume" :: held 0.920s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Created reservations ['28ea13b6-df34-4565-9a80-08cdac6d2e24', 'c3dea2ef-73b2-487e-9c19-bba5886d0273', '4e4e4c8a-cc2c-4763-9836-0a508858ffa7', '2e5b9512-94a7-47a1-8155-22800f27f1d8'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:19 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:10:19 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:20 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.395s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:20 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Deleted volume successfully. Nov 03 17:10:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ccf812ea-79bf-467f-9022-a8ad890e9201 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-9bba33b2-9dd6-42a2-a57f-4b6f4330bd6b-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "cinder-1c595389-6439-479d-984d-ace1d38ac09b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-1c595389-6439-479d-984d-ace1d38ac09b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "cinder-quobyte-1c595389-6439-479d-984d-ace1d38ac09b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-quobyte-1c595389-6439-479d-984d-ace1d38ac09b" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:21 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb06370-b6b8-4b32-99de-14e3f252e918]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:21 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b Nov 03 17:10:21 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:21 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b" returned: 0 in 0.669s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:21 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b Nov 03 17:10:21 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:22 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1c595389-6439-479d-984d-ace1d38ac09b" returned: 0 in 0.533s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-quobyte-1c595389-6439-479d-984d-ace1d38ac09b" released by "delete_volume" :: held 1.303s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Created reservations ['3cad78cf-ed6b-4c5f-a09a-38c8d9b9025c', 'f10673eb-f333-417d-98e9-869aada02b1a', 'e80f6333-dc17-4118-af92-092c1bc665d8', '73d1dfbc-75d1-4c9f-9a8d-59e67d2a649d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:22 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:10:22 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:22 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.340s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Deleted volume successfully. Nov 03 17:10:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19952796-f41f-4eb2-bc76-111f563c6601 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-1c595389-6439-479d-984d-ace1d38ac09b-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "cinder-9b7b20fc-97ae-4144-9c83-9c7900090613-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-9b7b20fc-97ae-4144-9c83-9c7900090613-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "cinder-quobyte-9b7b20fc-97ae-4144-9c83-9c7900090613" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-quobyte-9b7b20fc-97ae-4144-9c83-9c7900090613" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:23 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6df0181-ceb8-454c-8bf7-cd6a623bf50e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:23 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 Nov 03 17:10:23 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:24 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613" returned: 0 in 0.465s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:24 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613 Nov 03 17:10:24 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:24 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-9b7b20fc-97ae-4144-9c83-9c7900090613" returned: 0 in 0.311s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-quobyte-9b7b20fc-97ae-4144-9c83-9c7900090613" released by "delete_volume" :: held 0.842s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Created reservations ['4c76d68a-95ba-4b55-9ede-3e604dac570b', '13ddbfd0-86c6-4f84-b71a-4ce14be22b68', '00c6608d-9a84-4be0-bb03-a971be37f448', 'b33b0dce-3f43-4278-9109-9daf16414d54'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:24 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:10:24 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:24 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.282s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Deleted volume successfully. Nov 03 17:10:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2efec404-10d5-4ebf-9023-74e7757c9bd8 tempest-VolumesListTestJSON-1673130132 None] Lock "cinder-9b7b20fc-97ae-4144-9c83-9c7900090613-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:10:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:30 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:10:30 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:31 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.709s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:10:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:10:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:10:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-9e4190b6-cc9f-4818-80b9-97575ea60a4b tempest-TestShelveInstance-2028148084 None] Terminate volume connection completed successfully. Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-9e4190b6-cc9f-4818-80b9-97575ea60a4b tempest-TestShelveInstance-2028148084 None] Deleting attachment a6ccfbe9-4ebf-4db0-8b33-7d46901c45a9. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Acquiring lock "cinder-ce48c9ae-f367-457c-9667-1f88c4ab5666-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Lock "cinder-ce48c9ae-f367-457c-9667-1f88c4ab5666-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Acquiring lock "cinder-quobyte-ce48c9ae-f367-457c-9667-1f88c4ab5666" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Lock "cinder-quobyte-ce48c9ae-f367-457c-9667-1f88c4ab5666" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f665d96f-b23c-4647-83d0-5f7650adc387]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:33 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 Nov 03 17:10:33 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:33 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666" returned: 0 in 0.491s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:33 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666 Nov 03 17:10:34 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:34 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ce48c9ae-f367-457c-9667-1f88c4ab5666" returned: 0 in 0.412s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Lock "cinder-quobyte-ce48c9ae-f367-457c-9667-1f88c4ab5666" released by "delete_volume" :: held 0.966s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG cinder.quota [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Created reservations ['3eaa5752-178f-4f98-b656-7152c465836d', '03c874c8-bd70-4147-baf1-a4f4ac259ade', 'b690282f-6120-49b6-830c-7eb0c8260d75', 'c0554ead-262d-4cbb-9693-c976359ffb6f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:34 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:10:34 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:34 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.324s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG cinder.manager [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Deleted volume successfully. Nov 03 17:10:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [req-c744f0a9-5ff8-451f-ad1e-dd5235d0ab4d req-5cd2122a-cb07-4c7b-bd9b-3475e24423ef tempest-TestShelveInstance-2028148084 None] Lock "cinder-ce48c9ae-f367-457c-9667-1f88c4ab5666-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (ca3d4c22-24f9-4078-b1e2-2d99f7532c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341c6d0b-57da-436b-b11e-d12a830f502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341c6d0b-57da-436b-b11e-d12a830f502c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-330963434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b0bc74-8b89-4c95-925f-91cd121ca448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec4b66459445deaec189589bb66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:44Z,use_quota=True,user_id='6d7e89bf748a40c6a6d274460566a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa382ceb-7216-4604-8907-e6178e57d844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa382ceb-7216-4604-8907-e6178e57d844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737a0c12-59f5-443f-96af-ea58f5418cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737a0c12-59f5-443f-96af-ea58f5418cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b0bc74-8b89-4c95-925f-91cd121ca448', 'volume_name': 'volume-91b0bc74-8b89-4c95-925f-91cd121ca448', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f6406f-80e5-4ec0-9f23-de798daa0940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f6406f-80e5-4ec0-9f23-de798daa0940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e139b9d0-9428-4704-a215-49e255692efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:43 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Volume 91b0bc74-8b89-4c95-925f-91cd121ca448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b0bc74-8b89-4c95-925f-91cd121ca448', 'volume_size': 1} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-330963434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b0bc74-8b89-4c95-925f-91cd121ca448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec4b66459445deaec189589bb66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:44Z,use_quota=True,user_id='6d7e89bf748a40c6a6d274460566a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Creating volume 91b0bc74-8b89-4c95-925f-91cd121ca448 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:43 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:10:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:43 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 1073741824 Nov 03 17:10:43 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-2026c5fa-17de-46d5-a7a9-6d09c7785456 req-95465afa-964f-4dd0-9caa-8a36a87be313 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:44 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 1073741824" returned: 0 in 0.490s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:44 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 Nov 03 17:10:44 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:44 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448" returned: 0 in 0.271s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-2026c5fa-17de-46d5-a7a9-6d09c7785456 req-95465afa-964f-4dd0-9caa-8a36a87be313 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.525s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-2026c5fa-17de-46d5-a7a9-6d09c7785456 req-95465afa-964f-4dd0-9caa-8a36a87be313 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e139b9d0-9428-4704-a215-49e255692efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b0bc74-8b89-4c95-925f-91cd121ca448', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890e336b-b96f-4d59-aa3c-432cafab0647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Volume volume-91b0bc74-8b89-4c95-925f-91cd121ca448 (91b0bc74-8b89-4c95-925f-91cd121ca448): created successfully Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890e336b-b96f-4d59-aa3c-432cafab0647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (ca3d4c22-24f9-4078-b1e2-2d99f7532c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3dd6552d-6fbf-421f-8155-1aa1c52cfdbb tempest-VolumesSnapshotTestJSON-611908048 None] Created volume successfully. Nov 03 17:10:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-2026c5fa-17de-46d5-a7a9-6d09c7785456 req-95465afa-964f-4dd0-9caa-8a36a87be313 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff190772-fc9d-4afd-93e1-80e89b6a2d73', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:10:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-2026c5fa-17de-46d5-a7a9-6d09c7785456 req-95465afa-964f-4dd0-9caa-8a36a87be313 tempest-TestServerVolumeAttachmentScenario-1360908729 None] attachment_update completed successfully. Nov 03 17:10:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Creating offline snapshot 10b39ce1-4d39-4921-99fd-a6281ab8fb3a of volume 91b0bc74-8b89-4c95-925f-91cd121ca448 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:10:46 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b706305-ba93-47ef-b882-89b16d745d7c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:46 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 Nov 03 17:10:46 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:47 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448" returned: 0 in 0.498s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:47 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a 1G Nov 03 17:10:47 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:47 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a 1G" returned: 0 in 0.503s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0bc74-8b89-4c95-925f-91cd121ca448 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:47 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0bc74-8b89-4c95-925f-91cd121ca448 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a Nov 03 17:10:47 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:48 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0bc74-8b89-4c95-925f-91cd121ca448 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a" returned: 0 in 0.406s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:48 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a is being set with open permissions: ugo+rw Nov 03 17:10:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:48 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a Nov 03 17:10:48 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:48 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a" returned: 0 in 0.311s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:48 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.info Nov 03 17:10:48 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:48 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.info" returned: 0 in 0.379s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:48 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.info is being set with open permissions: ugo+rw Nov 03 17:10:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:48 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.info Nov 03 17:10:48 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:49 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.info" returned: 0 in 0.306s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-976b95dd-bd5b-4cdb-9804-027a4747b2f6 tempest-VolumesSnapshotTestJSON-611908048 None] Create snapshot completed successfully Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-10b39ce1-4d39-4921-99fd-a6281ab8fb3a-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-10b39ce1-4d39-4921-99fd-a6281ab8fb3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-91b0bc74-8b89-4c95-925f-91cd121ca448" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-91b0bc74-8b89-4c95-925f-91cd121ca448" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-10b39ce1-4d39-4921-99fd-a6281ab8fb3a" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-10b39ce1-4d39-4921-99fd-a6281ab8fb3a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Deleting offline snapshot 10b39ce1-4d39-4921-99fd-a6281ab8fb3a of volume 91b0bc74-8b89-4c95-925f-91cd121ca448 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] snapshot_file for this snap is: volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[22380076-e0f1-485a-adf4-50db7fd4f73c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:50 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a Nov 03 17:10:50 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:50 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a" returned: 0 in 0.477s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b0bc74-8b89-4c95-925f-91cd121ca448(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[740a635e-6f3c-4011-8c72-6241bae5ee4c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:50 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 Nov 03 17:10:50 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:51 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448" returned: 0 in 0.466s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:51 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a Nov 03 17:10:51 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:51 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a" returned: 0 in 0.458s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:51 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a Nov 03 17:10:51 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-9cf50e0d-fed2-4405-b64a-17d53963e139 req-453ce971-a60e-4f09-bece-d3807f315d34 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-9cf50e0d-fed2-4405-b64a-17d53963e139 req-453ce971-a60e-4f09-bece-d3807f315d34 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [req-9cf50e0d-fed2-4405-b64a-17d53963e139 req-453ce971-a60e-4f09-bece-d3807f315d34 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:51 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-9cf50e0d-fed2-4405-b64a-17d53963e139 req-453ce971-a60e-4f09-bece-d3807f315d34 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126', 'name': 'volume-b798031c-f1a2-4dde-b4b6-784b07d22f14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea0fef8d-462f-4fef-a329-c7cd24d2130a', 'enforce_multipath': True} {{(pid=86939) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:10:52 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448.10b39ce1-4d39-4921-99fd-a6281ab8fb3a" returned: 0 in 0.281s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-10b39ce1-4d39-4921-99fd-a6281ab8fb3a" released by "_delete_snapshot" :: held 1.861s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-91b0bc74-8b89-4c95-925f-91cd121ca448" released by "delete_snapshot" :: held 1.895s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:52 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-9cf50e0d-fed2-4405-b64a-17d53963e139 req-453ce971-a60e-4f09-bece-d3807f315d34 tempest-TestServerVolumeAttachmentScenario-1360908729 None] attachment_update completed successfully. Nov 03 17:10:52 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Created reservations ['a4ed3056-ae11-4412-8dda-fb1e03188458', '0af09718-b28e-4f4e-aa12-45a575ede7bc', 'd27f9fcc-75b7-4331-a37b-2a4cdec73dec', 'da4502d8-dfa8-4814-b514-ea99fe5fa04a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:52 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Delete snapshot completed successfully. Nov 03 17:10:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f2f75806-2551-450e-b29c-3842f6cb8ac9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-10b39ce1-4d39-4921-99fd-a6281ab8fb3a-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (2bb09a6c-5be0-41df-b74c-93dc30b41eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2517c55c-a22c-4432-9132-b5616b4f2454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2517c55c-a22c-4432-9132-b5616b4f2454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1800738265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c0ae7b-7219-4f2e-b709-c23523f4a8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec4b66459445deaec189589bb66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:57Z,use_quota=True,user_id='6d7e89bf748a40c6a6d274460566a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873c5178-ccc1-496d-949f-b2a0ebedba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873c5178-ccc1-496d-949f-b2a0ebedba6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9ad797-d67d-489a-8bee-53d168418938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9ad797-d67d-489a-8bee-53d168418938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c0ae7b-7219-4f2e-b709-c23523f4a8fb', 'volume_name': 'volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c8f5ad-5ad6-42bd-bc22-d5d093f6feab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c8f5ad-5ad6-42bd-bc22-d5d093f6feab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09872f0-279f-46d7-8144-e0e4deffd827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Volume e6c0ae7b-7219-4f2e-b709-c23523f4a8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb', 'volume_size': 1} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1800738265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c0ae7b-7219-4f2e-b709-c23523f4a8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec4b66459445deaec189589bb66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:57Z,use_quota=True,user_id='6d7e89bf748a40c6a6d274460566a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Creating volume e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:57 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:57 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb 1073741824 Nov 03 17:10:57 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:57 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb 1073741824" returned: 0 in 0.484s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:58 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb Nov 03 17:10:58 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:59 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" returned: 0 in 0.314s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09872f0-279f-46d7-8144-e0e4deffd827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a83a030-b2fd-4c3e-ab78-f110c8344712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Volume volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb (e6c0ae7b-7219-4f2e-b709-c23523f4a8fb): created successfully Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a83a030-b2fd-4c3e-ab78-f110c8344712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (2bb09a6c-5be0-41df-b74c-93dc30b41eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-fe3987f0-9342-479a-818c-84e46a931a96 tempest-VolumesSnapshotTestJSON-611908048 None] Created volume successfully. Nov 03 17:10:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-b900e79e-84f7-46c4-8803-16b81b08d66d req-0ef92feb-5ac5-4a87-8dd7-5b428b0a0590 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Terminate volume connection completed successfully. Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-b900e79e-84f7-46c4-8803-16b81b08d66d req-0ef92feb-5ac5-4a87-8dd7-5b428b0a0590 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Deleting attachment ea0fef8d-462f-4fef-a329-c7cd24d2130a. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Creating offline snapshot d50e8998-20d6-484c-bf9c-be449899ea90 of volume e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Flow 'volume_create_manager' (ff0a4a91-8822-4620-9b69-5b13e3cf7cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c3bafa-a858-48da-bf99-ff80c6b33f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf174717-9bca-48ec-9edc-1b623cf43862]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c3bafa-a858-48da-bf99-ff80c6b33f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7630437-b2e9-4698-851d-58c4d181f906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b415b396f03c4c4f9cc95dee5ac7b4cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:00Z,use_quota=True,user_id='3e2ed4b7e2034d21ab22d5f895960ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9a6c5cc-162a-4dd2-a236-ce73957e8b37),volume_type_id=a9a6c5cc-162a-4dd2-a236-ce73957e8b37)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ac8760-47c7-44eb-90b7-178b9214407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ac8760-47c7-44eb-90b7-178b9214407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50395932-5b46-4cf0-97a5-1aa4146ece4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:59 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:10:59 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb Nov 03 17:10:59 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50395932-5b46-4cf0-97a5-1aa4146ece4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7630437-b2e9-4698-851d-58c4d181f906', 'volume_name': 'volume-d7630437-b2e9-4698-851d-58c4d181f906', 'volume_size': 1, 'image_id': 'bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80de3e7eea6751f9b765cf846053f97d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b415b396f03c4c4f9cc95dee5ac7b4cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0464b54375a4fdaa02019c4faa00ce2bee7ff1d024e1adf9e29cd5bc1255ebc00032525facea58f87e3b83943b7c796195968442523a6436bdd23aea07ce4ee4', 'id': 'bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'created_at': datetime.datetime(2026, 11, 3, 16, 10, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 10, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d4f4b9-ce90-4e93-a3e6-9faa1a6ee444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d4f4b9-ce90-4e93-a3e6-9faa1a6ee444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a22f26-fce3-4536-8f7e-468f9713f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:00 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Volume d7630437-b2e9-4698-851d-58c4d181f906: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7630437-b2e9-4698-851d-58c4d181f906', 'volume_size': 1, 'image_id': 'bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80de3e7eea6751f9b765cf846053f97d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b415b396f03c4c4f9cc95dee5ac7b4cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0464b54375a4fdaa02019c4faa00ce2bee7ff1d024e1adf9e29cd5bc1255ebc00032525facea58f87e3b83943b7c796195968442523a6436bdd23aea07ce4ee4', 'id': 'bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'created_at': datetime.datetime(2026, 11, 3, 16, 10, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 10, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Trying to clone d7630437-b2e9-4698-851d-58c4d181f906 from image bdfd8bb9-eed1-4ae7-b334-056b9021b2bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:11:00 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" returned: 0 in 0.413s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 1G Nov 03 17:11:00 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:11:00 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b76ab1-f62d-48f0-a268-ec17c2c65c87]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD Nov 03 17:11:00 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 1G" returned: 0 in 0.509s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 Nov 03 17:11:00 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [req-d6c625bc-358d-4ed3-a578-fa813f60f7c0 req-f619e729-7c93-471b-a1d7-6856c416ae75 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Terminate volume connection completed successfully. Nov 03 17:11:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [req-d6c625bc-358d-4ed3-a578-fa813f60f7c0 req-f619e729-7c93-471b-a1d7-6856c416ae75 tempest-TestServerVolumeAttachmentScenario-1360908729 None] Deleting attachment ff190772-fc9d-4afd-93e1-80e89b6a2d73. {{(pid=86939) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:11:00 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD Nov 03 17:11:00 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:01 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90" returned: 0 in 0.371s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 is being set with open permissions: ugo+rw Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:01 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 Nov 03 17:11:01 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:01 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD" returned: 1 in 0.411s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Temporary image bdfd8bb9-eed1-4ae7-b334-056b9021b2bb is fetched for user 3e2ed4b7e2034d21ab22d5f895960ccc. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=87,cinder:INSERT=24,cinder:UPDATE=83,cinder:DELETE=4 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8596c4f8-ca22-4150-b897-c814795d37af]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:01 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD Nov 03 17:11:01 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:01 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:01 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.info Nov 03 17:11:01 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:01 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:01 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.info" returned: 0 in 0.324s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.info is being set with open permissions: ugo+rw Nov 03 17:11:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:01 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD Nov 03 17:11:01 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:01 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.info Nov 03 17:11:01 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:02 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD" returned: 1 in 0.422s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:02 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.info" returned: 0 in 0.324s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7630437-b2e9-4698-851d-58c4d181f906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b415b396f03c4c4f9cc95dee5ac7b4cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:00Z,use_quota=True,user_id='3e2ed4b7e2034d21ab22d5f895960ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9a6c5cc-162a-4dd2-a236-ce73957e8b37),volume_type_id=a9a6c5cc-162a-4dd2-a236-ce73957e8b37)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Creating volume d7630437-b2e9-4698-851d-58c4d181f906 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:02 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:02 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 1073741824 Nov 03 17:11:02 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:02 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9157c6b5-161f-4b05-9a14-d728cb3c430a tempest-VolumesSnapshotTestJSON-611908048 None] Create snapshot completed successfully Nov 03 17:11:02 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 1073741824" returned: 0 in 0.702s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:02 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 Nov 03 17:11:02 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:03 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906" returned: 0 in 0.414s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Attempting download of bdfd8bb9-eed1-4ae7-b334-056b9021b2bb ((None, [{'url': 'file:///opt/stack/data/glance/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'metadata': {}}])) to volume d7630437-b2e9-4698-851d-58c4d181f906. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[073388ed-0a54-4893-b180-5e5477469218]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_52fp00jf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:03 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_52fp00jf Nov 03 17:11:03 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:03 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_52fp00jf" returned: 0 in 0.432s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_52fp00jf {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (f3f058b6-849b-4489-80f5-d65705a2df0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd83929a-c739-464b-bce0-1578b0eeeb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd83929a-c739-464b-bce0-1578b0eeeb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2075094682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62511b9-dce6-4719-ad6a-b304cf8b01b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec4b66459445deaec189589bb66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d50e8998-20d6-484c-bf9c-be449899ea90,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:04Z,use_quota=True,user_id='6d7e89bf748a40c6a6d274460566a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814a95de-bba0-4975-9350-4c8d35d2833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814a95de-bba0-4975-9350-4c8d35d2833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:04 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_52fp00jf Nov 03 17:11:04 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8cbb98-e2f6-4ae7-84e1-57267399c6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8cbb98-e2f6-4ae7-84e1-57267399c6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd62511b9-dce6-4719-ad6a-b304cf8b01b0', 'volume_name': 'volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0', 'volume_size': 2, 'snapshot_id': 'd50e8998-20d6-484c-bf9c-be449899ea90'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642dbe0d-e773-4323-8559-5f40cf11baef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642dbe0d-e773-4323-8559-5f40cf11baef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d53894-7035-4d91-89de-f5ccd0b9ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Volume d62511b9-dce6-4719-ad6a-b304cf8b01b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0', 'volume_size': 2, 'snapshot_id': 'd50e8998-20d6-484c-bf9c-be449899ea90'} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-d50e8998-20d6-484c-bf9c-be449899ea90-d62511b9-dce6-4719-ad6a-b304cf8b01b0" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-d50e8998-20d6-484c-bf9c-be449899ea90-d62511b9-dce6-4719-ad6a-b304cf8b01b0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Creating volume d62511b9-dce6-4719-ad6a-b304cf8b01b0 from snapshot d50e8998-20d6-484c-bf9c-be449899ea90 {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-d62511b9-dce6-4719-ad6a-b304cf8b01b0" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-d62511b9-dce6-4719-ad6a-b304cf8b01b0" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] snapshot: d50e8998-20d6-484c-bf9c-be449899ea90, volume: d62511b9-dce6-4719-ad6a-b304cf8b01b0, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b36fa05-1b37-469f-bf0f-78f96cd9c39f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:04 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 Nov 03 17:11:04 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:04 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_52fp00jf" returned: 1 in 0.445s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_52fp00jf' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ef69c7-473d-4164-9ea3-fe9ff2c093ec]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:04 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD Nov 03 17:11:04 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:04 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90" returned: 0 in 0.445s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9542e9e-b0d1-4d79-a2fd-94b9380482a4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:04 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:04 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb Nov 03 17:11:04 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:04 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD Nov 03 17:11:04 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:05 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" returned: 0 in 0.480s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:05 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 Nov 03 17:11:05 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:05 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] bdfd8bb9-eed1-4ae7-b334-056b9021b2bb was raw, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:05 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 Nov 03 17:11:05 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "cinder-b798031c-f1a2-4dde-b4b6-784b07d22f14-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "cinder-b798031c-f1a2-4dde-b4b6-784b07d22f14-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "cinder-quobyte-b798031c-f1a2-4dde-b4b6-784b07d22f14" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "cinder-quobyte-b798031c-f1a2-4dde-b4b6-784b07d22f14" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab7dc3-8f07-4421-924e-67d7ead0dfc1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:06 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906" returned: 0 in 0.949s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdfd8bb9-eed1-4ae7-b334-056b9021b2bb_lv80srlbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:11:06 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:06 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 1G Nov 03 17:11:06 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:06 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 Nov 03 17:11:06 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:06 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 1G" returned: 0 in 0.706s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Downloaded image bdfd8bb9-eed1-4ae7-b334-056b9021b2bb ((None, [{'url': 'file:///opt/stack/data/glance/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'metadata': {}}])) to volume d7630437-b2e9-4698-851d-58c4d181f906 successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Temporary image bdfd8bb9-eed1-4ae7-b334-056b9021b2bb for user 3e2ed4b7e2034d21ab22d5f895960ccc is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Marking volume d7630437-b2e9-4698-851d-58c4d181f906 as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Copying metadata from image bdfd8bb9-eed1-4ae7-b334-056b9021b2bb to d7630437-b2e9-4698-851d-58c4d181f906. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:11:06 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Creating volume glance metadata for volume d7630437-b2e9-4698-851d-58c4d181f906 backed by image bdfd8bb9-eed1-4ae7-b334-056b9021b2bb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '80de3e7eea6751f9b765cf846053f97d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:11:07 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14" returned: 0 in 0.922s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:07 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14 Nov 03 17:11:07 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a22f26-fce3-4536-8f7e-468f9713f92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7630437-b2e9-4698-851d-58c4d181f906', 'volume_size': 1, 'image_id': 'bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80de3e7eea6751f9b765cf846053f97d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b415b396f03c4c4f9cc95dee5ac7b4cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0464b54375a4fdaa02019c4faa00ce2bee7ff1d024e1adf9e29cd5bc1255ebc00032525facea58f87e3b83943b7c796195968442523a6436bdd23aea07ce4ee4', 'id': 'bdfd8bb9-eed1-4ae7-b334-056b9021b2bb', 'created_at': datetime.datetime(2026, 11, 3, 16, 10, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 10, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdfd8bb9-eed1-4ae7-b334-056b9021b2bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44174ae-71d2-4a34-8ab0-ee695a7a7581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Volume volume-d7630437-b2e9-4698-851d-58c4d181f906 (d7630437-b2e9-4698-851d-58c4d181f906): created successfully Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44174ae-71d2-4a34-8ab0-ee695a7a7581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Flow 'volume_create_manager' (ff0a4a91-8822-4620-9b69-5b13e3cf7cc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cefc7e8f-b1d1-4b73-bda5-bbea88f8f7a6 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Created volume successfully. Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Acquiring lock "cinder-d7630437-b2e9-4698-851d-58c4d181f906-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "cinder-d7630437-b2e9-4698-851d-58c4d181f906-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:07 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b798031c-f1a2-4dde-b4b6-784b07d22f14" returned: 0 in 0.563s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Acquiring lock "cinder-quobyte-d7630437-b2e9-4698-851d-58c4d181f906" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "cinder-quobyte-b798031c-f1a2-4dde-b4b6-784b07d22f14" released by "delete_volume" :: held 1.590s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "cinder-quobyte-d7630437-b2e9-4698-851d-58c4d181f906" acquired by "delete_volume" :: waited 0.048s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90dc575-2777-42c6-9536-482c450c93fc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:07 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Created reservations ['313a98fe-2a4b-44b3-afe9-64244da7ee19', '6d3d46b3-7898-4ff3-bc6f-aa48a677edb8', '634ea01d-d157-494e-91e8-00a0b7c25206', 'd6490d5e-fda2-4b56-b691-148d7e02128b'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:07 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 Nov 03 17:11:07 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:08 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:08 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "cinder-25eea61d-1d78-41ed-aeb3-2d455aaa21bc-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "cinder-25eea61d-1d78-41ed-aeb3-2d455aaa21bc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:08 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:08 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906" returned: 0 in 0.763s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.469s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:08 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906 Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "cinder-quobyte-25eea61d-1d78-41ed-aeb3-2d455aaa21bc" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:08 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Deleted volume successfully. Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "cinder-quobyte-25eea61d-1d78-41ed-aeb3-2d455aaa21bc" acquired by "delete_volume" :: waited 0.038s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3607c8ff-3651-4479-aa71-009342eeb9bb tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "cinder-b798031c-f1a2-4dde-b4b6-784b07d22f14-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d383b22-8f49-46bb-9997-4e9206184589]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:08 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc Nov 03 17:11:08 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:08 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d7630437-b2e9-4698-851d-58c4d181f906" returned: 0 in 0.424s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "cinder-quobyte-d7630437-b2e9-4698-851d-58c4d181f906" released by "delete_volume" :: held 1.287s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:09 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:11:09 devstack cinder-volume[86939]: WARNING cinder.quota [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Created reservations ['e96c9863-7c8b-400a-af0f-b5e07092346d', 'a082c987-4a38-4a49-b0d8-61acd264dc56', '4b145a78-16b0-4e03-b8fc-e3d856231019', '91445d65-a337-4c3d-b38d-2bc1e561281f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:09 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:09 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:09 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc" returned: 0 in 0.807s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:09 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc Nov 03 17:11:09 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:09 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.533s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:09 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Deleted volume successfully. Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0b09663e-d6aa-4a35-8547-d5ee5420a3f2 tempest-VolumeAndVolumeTypeFromImageTest-613399974 None] Lock "cinder-d7630437-b2e9-4698-851d-58c4d181f906-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:09 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-25eea61d-1d78-41ed-aeb3-2d455aaa21bc" returned: 0 in 0.484s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "cinder-quobyte-25eea61d-1d78-41ed-aeb3-2d455aaa21bc" released by "delete_volume" :: held 1.391s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Created reservations ['1bb26b35-f632-4b28-a8f9-3d7c2b800881', 'ef4da57f-6347-4e18-9152-0e7e22b336d0', '84ef2858-1d6f-452a-be32-9752aecd56b6', '0d3d7786-e6eb-4a65-b361-663ff10bf137'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:10 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:10 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:10 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.425s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:10 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Deleted volume successfully. Nov 03 17:11:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cdfab6af-0dbb-4007-8ef8-17d4b5ae6e7f tempest-TestServerVolumeAttachmentScenario-1360908729 None] Lock "cinder-25eea61d-1d78-41ed-aeb3-2d455aaa21bc-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:13 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0" returned: 0 in 8.253s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:11:13 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Converted 1024.00 MB image at 124.07 MB/s Nov 03 17:11:13 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 is being set with open permissions: ugo+rw Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:13 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 Nov 03 17:11:13 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:13 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0" returned: 0 in 0.319s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-d62511b9-dce6-4719-ad6a-b304cf8b01b0" released by "_copy_volume_from_snapshot" :: held 9.614s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-d50e8998-20d6-484c-bf9c-be449899ea90-d62511b9-dce6-4719-ad6a-b304cf8b01b0" released by "_create_volume_from_snapshot" :: held 9.724s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.747s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d53894-7035-4d91-89de-f5ccd0b9ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0', 'volume_size': 2, 'snapshot_id': 'd50e8998-20d6-484c-bf9c-be449899ea90'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a5b0f6-782d-4ccc-b038-e37aec583b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:13 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Volume volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 (d62511b9-dce6-4719-ad6a-b304cf8b01b0): created successfully Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a5b0f6-782d-4ccc-b038-e37aec583b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (f3f058b6-849b-4489-80f5-d65705a2df0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e7714b5e-9a77-43e7-b84b-80492a35ec21 tempest-VolumesSnapshotTestJSON-611908048 None] Created volume successfully. Nov 03 17:11:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-d62511b9-dce6-4719-ad6a-b304cf8b01b0-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-d62511b9-dce6-4719-ad6a-b304cf8b01b0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:14 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:DELETE=9,cinder:UPDATE=83,cinder:SELECT=82,cinder:INSERT=24 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:11:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-d62511b9-dce6-4719-ad6a-b304cf8b01b0" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-d62511b9-dce6-4719-ad6a-b304cf8b01b0" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[057966ad-e43f-4971-981c-465b41ce8261]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:15 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 Nov 03 17:11:15 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:15 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0" returned: 0 in 0.390s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:15 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0 Nov 03 17:11:15 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:15 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d62511b9-dce6-4719-ad6a-b304cf8b01b0" returned: 0 in 0.258s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-d62511b9-dce6-4719-ad6a-b304cf8b01b0" released by "delete_volume" :: held 0.696s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Created reservations ['135d129e-8bff-4025-a50e-7331f2add8b5', 'd65993d5-57e5-47db-926c-575adb859b80', 'c9df624e-e7fd-4a36-a761-7e8f4de8ebc2', '5cb3f8f9-1bc5-4d0f-abe9-617850077438'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:15 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:15 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:16 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.357s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Deleted volume successfully. Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9d1cda4b-b890-4195-9025-0ddf08e0ac54 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-d62511b9-dce6-4719-ad6a-b304cf8b01b0-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-d50e8998-20d6-484c-bf9c-be449899ea90-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-d50e8998-20d6-484c-bf9c-be449899ea90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-d50e8998-20d6-484c-bf9c-be449899ea90" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-d50e8998-20d6-484c-bf9c-be449899ea90" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Deleting offline snapshot d50e8998-20d6-484c-bf9c-be449899ea90 of volume e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] snapshot_file for this snap is: volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4eeafd-2c57-45ab-bc6a-a721d568763b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:16 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 Nov 03 17:11:16 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:16 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90" returned: 0 in 0.437s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a69e94-a28a-4fec-8a0e-87c0658625b5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:17 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb Nov 03 17:11:17 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:17 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" returned: 0 in 0.692s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:17 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 Nov 03 17:11:17 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:17 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Flow 'volume_create_manager' (03374e9b-dfbf-4071-b3a5-0e3277599076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fc27fe-3a3b-4a1b-8c5e-75bb0f70373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:17 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fc27fe-3a3b-4a1b-8c5e-75bb0f70373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851922918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84851f49-8e4e-42fe-9373-aa42bac9be25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c23941f190a420680e8392e7530b223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:18Z,use_quota=True,user_id='82343d342c61465d9272c04e02c278c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5a347b-a7af-4afa-8003-03e5ebd52e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5a347b-a7af-4afa-8003-03e5ebd52e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da52bfb0-ecb2-4185-8bf9-e58f4f5f9c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da52bfb0-ecb2-4185-8bf9-e58f4f5f9c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84851f49-8e4e-42fe-9373-aa42bac9be25', 'volume_name': 'volume-84851f49-8e4e-42fe-9373-aa42bac9be25', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9e322e-7978-4704-ad2f-c30cc4243dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9e322e-7978-4704-ad2f-c30cc4243dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77169691-1a64-4542-a006-5c3bdb0f671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Volume 84851f49-8e4e-42fe-9373-aa42bac9be25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84851f49-8e4e-42fe-9373-aa42bac9be25', 'volume_size': 1} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851922918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84851f49-8e4e-42fe-9373-aa42bac9be25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c23941f190a420680e8392e7530b223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:18Z,use_quota=True,user_id='82343d342c61465d9272c04e02c278c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Creating volume 84851f49-8e4e-42fe-9373-aa42bac9be25 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:18 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90" returned: 0 in 0.515s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:18 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 1073741824 Nov 03 17:11:18 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:18 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90 Nov 03 17:11:18 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:18 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb.d50e8998-20d6-484c-bf9c-be449899ea90" returned: 0 in 0.297s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-d50e8998-20d6-484c-bf9c-be449899ea90" released by "_delete_snapshot" :: held 2.088s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" released by "delete_snapshot" :: held 2.118s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Created reservations ['b18e65e6-d4ce-4b74-9ae4-a99ef385c43e', '4c496a94-4c1d-447a-9b73-4dfb28bbfba8', '31e72d8a-5cf1-4be9-b58b-1cd93116f1ec', '4ecee247-22c0-4332-8f1f-b7d07a695f19'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Delete snapshot completed successfully. Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-38c68878-c26d-410e-a040-d5ecb703f5ae tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-d50e8998-20d6-484c-bf9c-be449899ea90-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:18 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 1073741824" returned: 0 in 0.566s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:18 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 Nov 03 17:11:18 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:18 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25" returned: 0 in 0.266s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77169691-1a64-4542-a006-5c3bdb0f671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84851f49-8e4e-42fe-9373-aa42bac9be25', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3d9baa-9b01-4c17-a64c-930a9101c436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Volume volume-84851f49-8e4e-42fe-9373-aa42bac9be25 (84851f49-8e4e-42fe-9373-aa42bac9be25): created successfully Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3d9baa-9b01-4c17-a64c-930a9101c436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Flow 'volume_create_manager' (03374e9b-dfbf-4071-b3a5-0e3277599076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d31213e8-6f9f-44d6-9aa8-4e04f7cc3fb6 tempest-ProjectReaderTests-1804088246 None] Created volume successfully. Nov 03 17:11:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" acquired by "delete_volume" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6ce16-bfb9-4ae3-870c-e07d99236f1e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:19 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb Nov 03 17:11:19 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:20 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" returned: 0 in 0.443s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:20 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Acquiring lock "cinder-84851f49-8e4e-42fe-9373-aa42bac9be25-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:20 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Lock "cinder-84851f49-8e4e-42fe-9373-aa42bac9be25-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Acquiring lock "cinder-quobyte-84851f49-8e4e-42fe-9373-aa42bac9be25" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Lock "cinder-quobyte-84851f49-8e4e-42fe-9373-aa42bac9be25" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b92b7-c0f2-4176-9523-a2bb9d9d6e63]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:20 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 Nov 03 17:11:20 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:20 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" returned: 0 in 0.314s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb" released by "delete_volume" :: held 0.836s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Created reservations ['7da0a4a6-1d90-4ba3-8af1-b13c2d5e767f', '88abe000-45c7-4d88-bb98-869e251bcc3e', '398bd020-7f9b-4476-ac82-57e6811fad3b', '8da0292b-b88a-4c1e-b3d6-0883a3e431ef'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:20 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:20 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:20 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25" returned: 0 in 0.435s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:20 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25 Nov 03 17:11:20 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:20 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.292s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Deleted volume successfully. Nov 03 17:11:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa5dea45-24a3-4593-a062-931096f5f3de tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-e6c0ae7b-7219-4f2e-b709-c23523f4a8fb-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:21 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84851f49-8e4e-42fe-9373-aa42bac9be25" returned: 0 in 0.290s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Lock "cinder-quobyte-84851f49-8e4e-42fe-9373-aa42bac9be25" released by "delete_volume" :: held 0.769s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Created reservations ['dc17ef81-9b67-41c0-b467-412f40ffb8d4', 'f2eb6865-80e0-442d-b541-f5accb8269eb', '359d442c-ff42-46a5-8cae-e3eea1cffd1d', '371e8019-826d-4a1c-9608-41e7ffa90e3b'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:21 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:21 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (875daa41-016b-4fdf-ba7d-5d0f339b11d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6769514f-7143-4807-8204-30fb36fc7dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6769514f-7143-4807-8204-30fb36fc7dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1254261554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfca07f-a4f4-46fb-abf6-892b4c38cd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec4b66459445deaec189589bb66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:21Z,use_quota=True,user_id='6d7e89bf748a40c6a6d274460566a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b505e846-6d0b-4d13-bff4-78a5b1d7d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b505e846-6d0b-4d13-bff4-78a5b1d7d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31f4d98-73a8-426f-a06f-e5270b25a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31f4d98-73a8-426f-a06f-e5270b25a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfca07f-a4f4-46fb-abf6-892b4c38cd22', 'volume_name': 'volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bde5e7-4d0b-461f-a8d3-8e2577c9dca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:21 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bde5e7-4d0b-461f-a8d3-8e2577c9dca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930dcfe3-eb8e-4377-a2aa-778652878962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:21 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Volume adfca07f-a4f4-46fb-abf6-892b4c38cd22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22', 'volume_size': 1} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1254261554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfca07f-a4f4-46fb-abf6-892b4c38cd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec4b66459445deaec189589bb66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:21Z,use_quota=True,user_id='6d7e89bf748a40c6a6d274460566a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Creating volume adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:21 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.494s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Deleted volume successfully. Nov 03 17:11:21 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 1073741824 Nov 03 17:11:21 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-be7879db-d10b-4dfe-90bd-d06b44b9a23d tempest-ProjectReaderTests-1804088246 None] Lock "cinder-84851f49-8e4e-42fe-9373-aa42bac9be25-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Flow 'volume_create_manager' (fa5060a3-99c5-4d3a-a23a-f666cf1f2351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874bc84f-5ec1-4015-a9e5-ac111b425877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874bc84f-5ec1-4015-a9e5-ac111b425877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977913479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640fd384-a32f-4eee-968f-f6fa4045a530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c23941f190a420680e8392e7530b223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:22Z,use_quota=True,user_id='82343d342c61465d9272c04e02c278c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5232abea-7209-49cb-976c-4fa6ad4a336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5232abea-7209-49cb-976c-4fa6ad4a336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375058dc-aa40-4e15-9a91-52dd1cd3f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375058dc-aa40-4e15-9a91-52dd1cd3f334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640fd384-a32f-4eee-968f-f6fa4045a530', 'volume_name': 'volume-640fd384-a32f-4eee-968f-f6fa4045a530', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38acf6d5-88a6-43f9-87e8-fdd1d5d6d007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38acf6d5-88a6-43f9-87e8-fdd1d5d6d007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1e27d5-0fe9-4359-8b6d-51aeb0067cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:22 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Volume 640fd384-a32f-4eee-968f-f6fa4045a530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640fd384-a32f-4eee-968f-f6fa4045a530', 'volume_size': 1} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:22 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 1073741824" returned: 0 in 0.640s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:22 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 Nov 03 17:11:22 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:22 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22" returned: 0 in 0.334s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977913479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640fd384-a32f-4eee-968f-f6fa4045a530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c23941f190a420680e8392e7530b223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:22Z,use_quota=True,user_id='82343d342c61465d9272c04e02c278c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Creating volume 640fd384-a32f-4eee-968f-f6fa4045a530 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:22 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930dcfe3-eb8e-4377-a2aa-778652878962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:22 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 1073741824 Nov 03 17:11:22 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceffb9cc-67cb-43bf-b1d7-f05d534932c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:22 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Volume volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 (adfca07f-a4f4-46fb-abf6-892b4c38cd22): created successfully Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceffb9cc-67cb-43bf-b1d7-f05d534932c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (875daa41-016b-4fdf-ba7d-5d0f339b11d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9d9781a7-19e8-4360-83c8-997a05796824 tempest-VolumesSnapshotTestJSON-611908048 None] Created volume successfully. Nov 03 17:11:23 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 1073741824" returned: 0 in 0.578s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:23 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 Nov 03 17:11:23 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:23 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530" returned: 0 in 0.335s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.029s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1e27d5-0fe9-4359-8b6d-51aeb0067cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640fd384-a32f-4eee-968f-f6fa4045a530', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c5b0c1-9568-4927-b6c0-41826396bcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Creating offline snapshot bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 of volume adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:11:23 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Volume volume-640fd384-a32f-4eee-968f-f6fa4045a530 (640fd384-a32f-4eee-968f-f6fa4045a530): created successfully Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c5b0c1-9568-4927-b6c0-41826396bcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Flow 'volume_create_manager' (fa5060a3-99c5-4d3a-a23a-f666cf1f2351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[27878afa-efd9-41c9-b049-9afe5803e6c9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-18e99ac1-161b-4cf8-a52b-9ce11dc93583 tempest-ProjectReaderTests-1804088246 None] Created volume successfully. Nov 03 17:11:23 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 Nov 03 17:11:23 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:24 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22" returned: 0 in 0.444s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:24 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 1G Nov 03 17:11:24 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Acquiring lock "cinder-640fd384-a32f-4eee-968f-f6fa4045a530-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Lock "cinder-640fd384-a32f-4eee-968f-f6fa4045a530-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Acquiring lock "cinder-quobyte-640fd384-a32f-4eee-968f-f6fa4045a530" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Lock "cinder-quobyte-640fd384-a32f-4eee-968f-f6fa4045a530" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea63dc6f-a12e-4409-8c85-b69b42fbdb63]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:24 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 Nov 03 17:11:24 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:24 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 1G" returned: 0 in 0.511s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:24 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 Nov 03 17:11:24 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:24 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530" returned: 0 in 0.453s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:24 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530 Nov 03 17:11:24 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:25 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" returned: 0 in 0.382s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:25 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 is being set with open permissions: ugo+rw Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:25 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 Nov 03 17:11:25 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:25 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-640fd384-a32f-4eee-968f-f6fa4045a530" returned: 0 in 0.342s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Lock "cinder-quobyte-640fd384-a32f-4eee-968f-f6fa4045a530" released by "delete_volume" :: held 0.858s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Created reservations ['eb7aa55d-e097-498f-bb6e-ce1764730e79', 'a4380b2f-34ee-4c2c-a6fb-d0ed6ab5d42b', '9f7031e7-e21a-42ba-ac7d-99ac66105604', '2e13daf0-7c8d-44dc-9f30-c97d659240b9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:25 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" returned: 0 in 0.301s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:25 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:25 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:25 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.info Nov 03 17:11:25 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:25 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.349s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Deleted volume successfully. Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e976e01a-9e77-4a4b-b9c8-8f96901cdd49 tempest-ProjectReaderTests-1804088246 None] Lock "cinder-640fd384-a32f-4eee-968f-f6fa4045a530-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:25 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.info" returned: 0 in 0.341s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:25 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.info is being set with open permissions: ugo+rw Nov 03 17:11:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:25 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.info Nov 03 17:11:25 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:26 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.info" returned: 0 in 0.280s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-acc4a527-8083-45cb-b19c-39ece1afa58b tempest-VolumesSnapshotTestJSON-611908048 None] Create snapshot completed successfully Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (48bc3b66-df61-46c8-aea0-c0b6928845b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572de614-e609-4ad0-8039-a9680a5fae37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572de614-e609-4ad0-8039-a9680a5fae37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1827053932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:27Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3867332-f21c-46e4-8e8a-dc6b82dfc0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3867332-f21c-46e4-8e8a-dc6b82dfc0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47022447-5b05-45a3-a3ad-96d97fa74e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47022447-5b05-45a3-a3ad-96d97fa74e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775', 'volume_name': 'volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac9e62f-d5de-4943-ae26-c364c568cc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac9e62f-d5de-4943-ae26-c364c568cc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2852f486-6b6d-4b98-95ea-a57952b7b833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:27 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Volume 4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775', 'volume_size': 1} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1827053932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:27Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Creating volume 4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:27 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:27 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 1073741824 Nov 03 17:11:27 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (93b27aab-695c-4560-8f6f-11dc70928821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bba092-9c5b-46b7-b3e0-c7eb6ca1f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (52d52202-817f-482f-87a2-f156caf76fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:28 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9005c5cf-da7c-497f-b111-929369d97a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 1073741824" returned: 0 in 0.845s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bba092-9c5b-46b7-b3e0-c7eb6ca1f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-11601541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c3f075-6812-4c87-8fc3-3e0dc1b3a301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efec4b66459445deaec189589bb66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb1d1271-7075-4cbb-ae9c-d5e3f72fee03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:28Z,use_quota=True,user_id='6d7e89bf748a40c6a6d274460566a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bc066e-fc17-44cd-85f8-6926389bfde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bc066e-fc17-44cd-85f8-6926389bfde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e4b9df-a8f7-4f7d-914b-4b70161614a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e4b9df-a8f7-4f7d-914b-4b70161614a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5c3f075-6812-4c87-8fc3-3e0dc1b3a301', 'volume_name': 'volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301', 'volume_size': 1, 'snapshot_id': 'bb1d1271-7075-4cbb-ae9c-d5e3f72fee03'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27420ac2-ead1-4c4e-a0ff-426134f623ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27420ac2-ead1-4c4e-a0ff-426134f623ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0c7459-6305-4be1-a60a-ff0bbf7bc910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Volume c5c3f075-6812-4c87-8fc3-3e0dc1b3a301: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301', 'volume_size': 1, 'snapshot_id': 'bb1d1271-7075-4cbb-ae9c-d5e3f72fee03'} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9005c5cf-da7c-497f-b111-929369d97a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172804988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef659adb-0149-4d67-ac01-ba90c5b5df21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:28Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06bc89e-1dd3-4996-a827-57b3bda61a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06bc89e-1dd3-4996-a827-57b3bda61a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2e4d0c-cc30-4960-a142-9f7bf6a25312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2e4d0c-cc30-4960-a142-9f7bf6a25312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef659adb-0149-4d67-ac01-ba90c5b5df21', 'volume_name': 'volume-ef659adb-0149-4d67-ac01-ba90c5b5df21', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8a067b-df55-4546-a47b-c57a03a4a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8a067b-df55-4546-a47b-c57a03a4a39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91082df1-103e-42e9-a5c7-4bc0db57eda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Volume ef659adb-0149-4d67-ac01-ba90c5b5df21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef659adb-0149-4d67-ac01-ba90c5b5df21', 'volume_size': 1} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:28 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 Nov 03 17:11:28 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (9db49b59-bca0-4c56-aa8c-74ab4f3e1756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f67a65-f420-4858-9fa7-65de907ecd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f67a65-f420-4858-9fa7-65de907ecd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262228612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2014a111-a52e-4712-b6fc-84acb9079952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:28Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff80afff-c2ff-468b-a2dc-3b1e79163007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff80afff-c2ff-468b-a2dc-3b1e79163007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274b6280-4688-419a-ba01-f10a4039a0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274b6280-4688-419a-ba01-f10a4039a0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2014a111-a52e-4712-b6fc-84acb9079952', 'volume_name': 'volume-2014a111-a52e-4712-b6fc-84acb9079952', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c710dc4-7ea7-406c-90b9-9209d06756ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c710dc4-7ea7-406c-90b9-9209d06756ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7a109b-5006-4b6d-a150-21f9d2c02333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:28 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Volume 2014a111-a52e-4712-b6fc-84acb9079952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2014a111-a52e-4712-b6fc-84acb9079952', 'volume_size': 1} Nov 03 17:11:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:29 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775" returned: 0 in 0.413s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172804988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef659adb-0149-4d67-ac01-ba90c5b5df21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:28Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Creating volume ef659adb-0149-4d67-ac01-ba90c5b5df21 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:29 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:29 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 1073741824 Nov 03 17:11:29 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (36acdd29-b6bb-4e93-92f9-5524282272df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3708b58-bb7c-4734-88c9-89a56e3baf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2852f486-6b6d-4b98-95ea-a57952b7b833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7440082e-a10a-4c28-9944-40f57a01dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3708b58-bb7c-4734-88c9-89a56e3baf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-320653678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d24eae2-dd74-4f47-8b8d-47e56a4d366d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:29Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f450fc-22d3-4049-b573-57c9f968c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f450fc-22d3-4049-b573-57c9f968c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d5632e-7399-4c8c-bafb-9d8b45181e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d5632e-7399-4c8c-bafb-9d8b45181e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d24eae2-dd74-4f47-8b8d-47e56a4d366d', 'volume_name': 'volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c23126-8d9a-4f04-94bd-7b1c1bba93dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c23126-8d9a-4f04-94bd-7b1c1bba93dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bf2445-4cf7-44d6-b827-dd5992b5df7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Volume 6d24eae2-dd74-4f47-8b8d-47e56a4d366d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d', 'volume_size': 1} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:29 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Volume volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 (4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775): created successfully Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7440082e-a10a-4c28-9944-40f57a01dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (48bc3b66-df61-46c8-aea0-c0b6928845b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1a063962-756b-4a7f-833d-1237634c0cda tempest-CreateVolumesFromImageTest-1420797376 None] Created volume successfully. Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (8c96fd08-7bd2-47cf-865b-00d305b8b613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec208828-cd3c-4f3d-949f-d17e19eff2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec208828-cd3c-4f3d-949f-d17e19eff2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1568924559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:30Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f146f13-67d0-43d7-9b93-c2a3ddaa90d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f146f13-67d0-43d7-9b93-c2a3ddaa90d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb0d8cb-4379-4b07-88e2-1a231f8b840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb0d8cb-4379-4b07-88e2-1a231f8b840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b', 'volume_name': 'volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14b2213-a257-4701-8a54-a686bed3ad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14b2213-a257-4701-8a54-a686bed3ad97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:29 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33f718f-de5a-4e06-a2e3-f3e7b03b382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:29 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Volume 6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b', 'volume_size': 1} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 1073741824" returned: 0 in 0.679s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:29 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 Nov 03 17:11:29 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:30 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21" returned: 0 in 0.266s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.435s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91082df1-103e-42e9-a5c7-4bc0db57eda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef659adb-0149-4d67-ac01-ba90c5b5df21', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afe3137-2717-4d4e-a4cf-f3ac0f985445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Creating volume c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 from snapshot bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:30 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Volume volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 (ef659adb-0149-4d67-ac01-ba90c5b5df21): created successfully Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afe3137-2717-4d4e-a4cf-f3ac0f985445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (52d52202-817f-482f-87a2-f156caf76fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] snapshot: bb1d1271-7075-4cbb-ae9c-d5e3f72fee03, volume: c5c3f075-6812-4c87-8fc3-3e0dc1b3a301, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:11:30 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-83602110-5e38-4962-ac97-2d201a8d9123 tempest-CreateVolumesFromImageTest-1420797376 None] Created volume successfully. Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57fd4db-600e-44cc-b022-1514aa029066]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:30 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 Nov 03 17:11:30 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:30 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" returned: 0 in 0.381s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[793422a4-b6c4-4754-b70d-bd621011f45d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:30 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 Nov 03 17:11:30 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:30 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:30 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:31 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22" returned: 0 in 0.458s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:31 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 Nov 03 17:11:31 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Flow 'volume_create_manager' (5340e5bd-db1e-40c5-929e-f066f408890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed96839d-91a9-45cf-ab59-b7735c24d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:31 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed96839d-91a9-45cf-ab59-b7735c24d76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934233393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044b390a-677e-4f2c-829d-902583b5f1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa6e76dfa45b68e0ef612440ad36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:31Z,use_quota=True,user_id='92d6c87906364e368d513d18a626a713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992eed58-46be-4657-8add-675b9fe1b8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992eed58-46be-4657-8add-675b9fe1b8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9335744f-f2c0-416e-a11b-e8f314219d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9335744f-f2c0-416e-a11b-e8f314219d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044b390a-677e-4f2c-829d-902583b5f1b5', 'volume_name': 'volume-044b390a-677e-4f2c-829d-902583b5f1b5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c926f9e-3b8f-4dfb-8faa-11c59564cb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c926f9e-3b8f-4dfb-8faa-11c59564cb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1b55e4-16b5-4a3c-b19b-c3ead6c313dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:31 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Volume 044b390a-677e-4f2c-829d-902583b5f1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044b390a-677e-4f2c-829d-902583b5f1b5', 'volume_size': 1} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.352s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:11:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:11:36 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" returned: 0 in 5.816s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:36 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:11:36 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Converted 1024.00 MB image at 176.03 MB/s Nov 03 17:11:36 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 is being set with open permissions: ugo+rw Nov 03 17:11:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:36 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 Nov 03 17:11:36 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:37 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" returned: 0 in 0.259s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" released by "_copy_volume_from_snapshot" :: held 7.020s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" released by "_create_volume_from_snapshot" :: held 7.100s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.137s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.352s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262228612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2014a111-a52e-4712-b6fc-84acb9079952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:28Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Creating volume 2014a111-a52e-4712-b6fc-84acb9079952 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:37 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:37 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 1073741824 Nov 03 17:11:37 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0c7459-6305-4be1-a60a-ff0bbf7bc910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301', 'volume_size': 1, 'snapshot_id': 'bb1d1271-7075-4cbb-ae9c-d5e3f72fee03'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cf751f-220e-4357-b229-ea174af7656d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:37 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Volume volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 (c5c3f075-6812-4c87-8fc3-3e0dc1b3a301): created successfully Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cf751f-220e-4357-b229-ea174af7656d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Flow 'volume_create_manager' (93b27aab-695c-4560-8f6f-11dc70928821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6ada88c0-af12-4ed9-9eb6-58afe7fe28a9 tempest-VolumesSnapshotTestJSON-611908048 None] Created volume successfully. Nov 03 17:11:37 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 1073741824" returned: 0 in 0.443s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:37 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 Nov 03 17:11:37 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[0210a114-d04d-491b-9c43-359dde70a383]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:37 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 Nov 03 17:11:37 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:37 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952" returned: 0 in 0.252s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.686s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-320653678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d24eae2-dd74-4f47-8b8d-47e56a4d366d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:29Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Creating volume 6d24eae2-dd74-4f47-8b8d-47e56a4d366d {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:37 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7a109b-5006-4b6d-a150-21f9d2c02333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2014a111-a52e-4712-b6fc-84acb9079952', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:37 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d 1073741824 Nov 03 17:11:37 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ab149b-4b6c-4931-9f26-b4db89387f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:38 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Volume volume-2014a111-a52e-4712-b6fc-84acb9079952 (2014a111-a52e-4712-b6fc-84acb9079952): created successfully Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ab149b-4b6c-4931-9f26-b4db89387f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (9db49b59-bca0-4c56-aa8c-74ab4f3e1756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f95d754f-fc56-466e-be7d-73948870bd7e tempest-CreateVolumesFromImageTest-1420797376 None] Created volume successfully. Nov 03 17:11:38 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" returned: 0 in 0.378s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:38 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301 Nov 03 17:11:38 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:38 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d 1073741824" returned: 0 in 0.495s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:38 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" returned: 0 in 0.271s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301" released by "delete_volume" :: held 0.697s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:38 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d Nov 03 17:11:38 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Created reservations ['2dfbbd11-3383-4c70-8852-d2ffebf841f2', 'a04b26c5-c7dd-432a-b7a3-f5008451826d', '7f57fbbd-0697-4bd8-b992-3c88b30a7bb4', '8b0b2036-4961-4f73-9e7c-e41a2d3b2bab'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:38 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:38 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:38 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d" returned: 0 in 0.265s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.027s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1568924559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbfcae5097f4aae8a5aef7530003fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:30Z,use_quota=True,user_id='e180d026d22d4387a1f3cef7cf7f8c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Creating volume 6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:38 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bf2445-4cf7-44d6-b827-dd5992b5df7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543cb849-6818-49ea-8423-35216b9f0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:38 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b 1073741824 Nov 03 17:11:38 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:38 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Volume volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d (6d24eae2-dd74-4f47-8b8d-47e56a4d366d): created successfully Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543cb849-6818-49ea-8423-35216b9f0383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (36acdd29-b6bb-4e93-92f9-5524282272df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-498b97e3-dade-4cfb-a317-4b50f91b2332 tempest-CreateVolumesFromImageTest-1420797376 None] Created volume successfully. Nov 03 17:11:38 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.321s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:38 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Deleted volume successfully. Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff9ed5fc-ef72-40dc-b5e1-ff9b76819e70 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-c5c3f075-6812-4c87-8fc3-3e0dc1b3a301-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-adfca07f-a4f4-46fb-abf6-892b4c38cd22" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-adfca07f-a4f4-46fb-abf6-892b4c38cd22" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Deleting offline snapshot bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 of volume adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] snapshot_file for this snap is: volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbbcef2-e879-44fc-987b-a66508659eeb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:39 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 Nov 03 17:11:39 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:39 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b 1073741824" returned: 0 in 0.521s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:39 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b Nov 03 17:11:39 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:39 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" returned: 0 in 0.382s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[278d0715-3f64-4acc-a076-e52d172bd179]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:39 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b" returned: 0 in 0.247s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.374s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934233393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044b390a-677e-4f2c-829d-902583b5f1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa6e76dfa45b68e0ef612440ad36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:31Z,use_quota=True,user_id='92d6c87906364e368d513d18a626a713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Creating volume 044b390a-677e-4f2c-829d-902583b5f1b5 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:39 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 Nov 03 17:11:39 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:39 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:39 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 1073741824 Nov 03 17:11:39 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33f718f-de5a-4e06-a2e3-f3e7b03b382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ffd251-cfce-4d3a-9252-94140408e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:39 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Volume volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b (6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b): created successfully Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ffd251-cfce-4d3a-9252-94140408e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:39 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Flow 'volume_create_manager' (8c96fd08-7bd2-47cf-865b-00d305b8b613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-89e8f224-61c5-461a-9389-226699ad9bdb tempest-CreateVolumesFromImageTest-1420797376 None] Created volume successfully. Nov 03 17:11:40 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22" returned: 0 in 0.589s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:40 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 1073741824" returned: 0 in 0.482s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:40 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 Nov 03 17:11:40 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:40 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 Nov 03 17:11:40 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:40 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5" returned: 0 in 0.260s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1b55e4-16b5-4a3c-b19b-c3ead6c313dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044b390a-677e-4f2c-829d-902583b5f1b5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c7b0be-86ea-40d3-bc18-2c30fdae7e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:40 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Volume volume-044b390a-677e-4f2c-829d-902583b5f1b5 (044b390a-677e-4f2c-829d-902583b5f1b5): created successfully Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c7b0be-86ea-40d3-bc18-2c30fdae7e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:40 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Flow 'volume_create_manager' (5340e5bd-db1e-40c5-929e-f066f408890b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" returned: 0 in 0.362s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:40 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3686c341-a412-47e5-b410-5ef68d8e802d tempest-ProjectReaderTests-1049531057 None] Created volume successfully. Nov 03 17:11:40 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03 Nov 03 17:11:40 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:40 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22.bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" returned: 0 in 0.266s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03" released by "_delete_snapshot" :: held 1.716s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-adfca07f-a4f4-46fb-abf6-892b4c38cd22" released by "delete_snapshot" :: held 1.742s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Created reservations ['16d5184c-bc45-4913-a475-e9bdd7569f62', 'be7c14fe-f73f-4110-9bb9-baf845c0bf81', '313a6e94-f14d-4d76-99bf-c8676d681db6', '7f7d48ad-2d10-4e8f-a925-b305b45f7992'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-quobyte-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7b0034-b18b-4b77-9ac8-42d4c7b89a7d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Delete snapshot completed successfully. Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-d406b00c-3fb2-4b2d-827a-4ef927440676 tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-bb1d1271-7075-4cbb-ae9c-d5e3f72fee03-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:41 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b Nov 03 17:11:41 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "cinder-044b390a-677e-4f2c-829d-902583b5f1b5-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Lock "cinder-044b390a-677e-4f2c-829d-902583b5f1b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-adfca07f-a4f4-46fb-abf6-892b4c38cd22-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "cinder-quobyte-044b390a-677e-4f2c-829d-902583b5f1b5" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-adfca07f-a4f4-46fb-abf6-892b4c38cd22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Lock "cinder-quobyte-044b390a-677e-4f2c-829d-902583b5f1b5" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d98246-f4de-464f-8362-861d99e960e9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-adfca07f-a4f4-46fb-abf6-892b4c38cd22" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:41 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b" returned: 0 in 0.432s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-adfca07f-a4f4-46fb-abf6-892b4c38cd22" acquired by "delete_volume" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:41 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b Nov 03 17:11:41 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[917eabfe-0d45-4b0f-a9a7-1f60e8f8e18a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:41 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 Nov 03 17:11:41 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:41 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 Nov 03 17:11:41 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:41 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b" returned: 0 in 0.282s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b" released by "delete_volume" :: held 0.772s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Created reservations ['aa476389-58cb-406d-ad85-79e1f58f327a', 'be65a001-1f00-4ddd-b662-86d204311217', 'fc82caed-f048-4b80-b1dd-2e3819580164', '2891ba5c-724f-422c-8cb6-4b612f3d50bf'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:41 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5" returned: 0 in 0.463s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:41 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5 Nov 03 17:11:41 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:41 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:41 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:41 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22" returned: 0 in 0.426s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:41 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22 Nov 03 17:11:41 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-6d24eae2-dd74-4f47-8b8d-47e56a4d366d-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-6d24eae2-dd74-4f47-8b8d-47e56a4d366d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-quobyte-6d24eae2-dd74-4f47-8b8d-47e56a4d366d" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-6d24eae2-dd74-4f47-8b8d-47e56a4d366d" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:42 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-044b390a-677e-4f2c-829d-902583b5f1b5" returned: 0 in 0.335s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f08b17d-d327-41cc-b93d-d9899647dc42]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:42 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.322s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Lock "cinder-quobyte-044b390a-677e-4f2c-829d-902583b5f1b5" released by "delete_volume" :: held 0.870s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Deleted volume successfully. Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b484c2a2-520a-411a-92c8-a8c95d5b2dc7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-6d1319dd-eaa8-4fe5-b7e8-ad20cdb6b46b-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Created reservations ['d2ef50ff-0b8f-4e3b-9a95-0a00ed92049d', '595415a1-3e85-4c37-9b0d-e8e820f7d4d7', '3920b43b-d499-4bef-8044-1d2355f7a319', 'be845fa0-3ff3-4295-8195-1dd5693097be'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:42 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-adfca07f-a4f4-46fb-abf6-892b4c38cd22" returned: 0 in 0.373s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-adfca07f-a4f4-46fb-abf6-892b4c38cd22" released by "delete_volume" :: held 0.875s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:42 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d Nov 03 17:11:42 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Created reservations ['ae0f7724-9844-4ad1-9c17-9bbee2e75721', 'c96e0e1d-3897-4fc6-a208-6892f7373e0c', 'cf235075-a8a4-4229-8807-f1d5400c66a1', '957e8bc3-e2f9-4560-900d-2166e7888429'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:42 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:42 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:42 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:42 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:42 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d" returned: 0 in 0.499s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:42 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d Nov 03 17:11:42 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:42 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.406s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Deleted volume successfully. Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-91b0bc74-8b89-4c95-925f-91cd121ca448-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-8ed1e0b1-0ea6-41ba-9813-9b94989d2d17 tempest-ProjectReaderTests-1049531057 None] Lock "cinder-044b390a-677e-4f2c-829d-902583b5f1b5-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-91b0bc74-8b89-4c95-925f-91cd121ca448-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "cinder-quobyte-91b0bc74-8b89-4c95-925f-91cd121ca448" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:42 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-91b0bc74-8b89-4c95-925f-91cd121ca448" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.498s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:43 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Deleted volume successfully. Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e4a52e-7aaa-49d0-bead-810d82ca17b1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a7013547-d6c0-4643-958a-a5da22a9c56e tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-adfca07f-a4f4-46fb-abf6-892b4c38cd22-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Flow 'volume_create_manager' (bb707eca-da47-4c08-9d0c-ca56ec1a8538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:43 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef275595-56bc-41e9-8fe7-fd12da03d670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6d24eae2-dd74-4f47-8b8d-47e56a4d366d" returned: 0 in 0.444s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef275595-56bc-41e9-8fe7-fd12da03d670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249033826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d75077-5a5e-4ab6-b4c6-75e39c9278e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa6e76dfa45b68e0ef612440ad36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:43Z,use_quota=True,user_id='92d6c87906364e368d513d18a626a713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda31601-346d-4601-8274-8cd9529981cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda31601-346d-4601-8274-8cd9529981cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9383b5d2-2f08-4b64-845a-6c22c3fa222c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9383b5d2-2f08-4b64-845a-6c22c3fa222c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d75077-5a5e-4ab6-b4c6-75e39c9278e4', 'volume_name': 'volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eafcfbc-9541-4d8c-b231-5bd01549e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:43 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 Nov 03 17:11:43 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eafcfbc-9541-4d8c-b231-5bd01549e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3566d9-b176-473e-9337-ff513edfbd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:43 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Volume 24d75077-5a5e-4ab6-b4c6-75e39c9278e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4', 'volume_size': 1} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249033826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d75077-5a5e-4ab6-b4c6-75e39c9278e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa6e76dfa45b68e0ef612440ad36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:43Z,use_quota=True,user_id='92d6c87906364e368d513d18a626a713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Creating volume 24d75077-5a5e-4ab6-b4c6-75e39c9278e4 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:43 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-6d24eae2-dd74-4f47-8b8d-47e56a4d366d" released by "delete_volume" :: held 1.076s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:43 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 1073741824 Nov 03 17:11:43 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Created reservations ['9491f551-06de-45b6-9952-e487e4454bb7', '52d7850c-b8c9-41ea-a8ce-aae8e280a768', '6d7dc31b-3ca2-47e6-808e-45bcfd98bd35', 'a43fb078-2b72-4f92-8e73-e9495271d629'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:43 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:43 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:43 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448" returned: 0 in 0.432s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:43 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448 Nov 03 17:11:43 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:43 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.272s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:43 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Deleted volume successfully. Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-a703eace-740d-4b68-9e75-7cc30725d8a7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-6d24eae2-dd74-4f47-8b8d-47e56a4d366d-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:43 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 1073741824" returned: 0 in 0.483s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:43 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 Nov 03 17:11:43 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:43 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91b0bc74-8b89-4c95-925f-91cd121ca448" returned: 0 in 0.284s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-quobyte-91b0bc74-8b89-4c95-925f-91cd121ca448" released by "delete_volume" :: held 0.815s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Created reservations ['e514380e-a3e3-49d4-97de-7382b9b15548', '0c366bf0-5387-4a8e-8ab2-2ada80d97def', 'b9713754-c46f-4504-9217-e70c5dc0557c', '5482b5db-629e-4d44-8c93-073b6012831f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:43 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:43 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:43 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4" returned: 0 in 0.271s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3566d9-b176-473e-9337-ff513edfbd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7816062-7360-462a-8548-2ebcca167fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Volume volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 (24d75077-5a5e-4ab6-b4c6-75e39c9278e4): created successfully Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7816062-7360-462a-8548-2ebcca167fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Flow 'volume_create_manager' (bb707eca-da47-4c08-9d0c-ca56ec1a8538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-232c0e99-21bf-4747-b7e6-7f48bda5d55c tempest-ProjectReaderTests-1049531057 None] Created volume successfully. Nov 03 17:11:44 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.288s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Deleted volume successfully. Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b38e7817-4d71-4a97-94f9-ee3dad7ca9eb tempest-VolumesSnapshotTestJSON-611908048 None] Lock "cinder-91b0bc74-8b89-4c95-925f-91cd121ca448-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-2014a111-a52e-4712-b6fc-84acb9079952-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-2014a111-a52e-4712-b6fc-84acb9079952-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-quobyte-2014a111-a52e-4712-b6fc-84acb9079952" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-2014a111-a52e-4712-b6fc-84acb9079952" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[45725fac-d03a-405f-914a-4d7a795e4ddf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:44 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 Nov 03 17:11:44 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:44 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952" returned: 0 in 0.433s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:44 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952 Nov 03 17:11:44 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:45 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-2014a111-a52e-4712-b6fc-84acb9079952" returned: 0 in 0.298s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-2014a111-a52e-4712-b6fc-84acb9079952" released by "delete_volume" :: held 0.785s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Created reservations ['f17a2344-c475-498b-8860-43e9b3fad305', '7ef436e3-db58-4cba-a77b-b472c5eb9b32', 'd6de0105-5b25-4261-924e-21f51dff2a9f', '18675999-7f68-44d5-9415-d0d3c0708039'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Acquiring lock "cinder-24d75077-5a5e-4ab6-b4c6-75e39c9278e4-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Lock "cinder-24d75077-5a5e-4ab6-b4c6-75e39c9278e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Acquiring lock "cinder-quobyte-24d75077-5a5e-4ab6-b4c6-75e39c9278e4" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Lock "cinder-quobyte-24d75077-5a5e-4ab6-b4c6-75e39c9278e4" acquired by "delete_volume" :: waited 0.045s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[da04a35c-87bf-40c4-9a5a-ee3b364c40e0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:45 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:45 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-ef659adb-0149-4d67-ac01-ba90c5b5df21-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-ef659adb-0149-4d67-ac01-ba90c5b5df21-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-quobyte-ef659adb-0149-4d67-ac01-ba90c5b5df21" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-ef659adb-0149-4d67-ac01-ba90c5b5df21" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:45 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 Nov 03 17:11:45 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48e6e17-7c9a-40f7-aec5-67dd4bfec53d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:45 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 Nov 03 17:11:45 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:46 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.526s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Deleted volume successfully. Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-683d999a-c323-475b-a95b-c041d91a47f7 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-2014a111-a52e-4712-b6fc-84acb9079952-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:46 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4" returned: 0 in 0.580s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:46 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4 Nov 03 17:11:46 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:46 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21" returned: 0 in 0.561s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:46 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21 Nov 03 17:11:46 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:46 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-24d75077-5a5e-4ab6-b4c6-75e39c9278e4" returned: 0 in 0.323s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Lock "cinder-quobyte-24d75077-5a5e-4ab6-b4c6-75e39c9278e4" released by "delete_volume" :: held 0.990s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Created reservations ['19456c62-b9ff-400a-99f7-32c57bd65771', 'c0e80d82-0318-4871-9602-a225b7a45650', '372f2770-d1d9-4fe1-b2e4-74c1a073ecdb', 'f604552a-c8fd-47a5-aa53-232f318915ed'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:46 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ef659adb-0149-4d67-ac01-ba90c5b5df21" returned: 0 in 0.349s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:46 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-ef659adb-0149-4d67-ac01-ba90c5b5df21" released by "delete_volume" :: held 0.998s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:46 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Created reservations ['12a67ba1-79ac-4b33-9e1d-3cbc5fb6fd89', '071968c1-5798-413e-86b9-a04ba382b151', 'be65fed2-c078-423d-9561-80dd8f903a4d', '9c4a829a-ec01-4972-8c50-809e62343d00'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:46 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:46 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:46 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.344s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:46 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Deleted volume successfully. Nov 03 17:11:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-44d8529f-4245-4dcc-9aab-e3c464c8878a tempest-ProjectReaderTests-1049531057 None] Lock "cinder-24d75077-5a5e-4ab6-b4c6-75e39c9278e4-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:47 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.299s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:47 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Deleted volume successfully. Nov 03 17:11:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b40d6646-0536-4062-8d3a-916f0474d124 tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-ef659adb-0149-4d67-ac01-ba90c5b5df21-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "cinder-quobyte-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b333140-a534-4e93-9b0e-4dde521ecec8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Flow 'volume_create_manager' (f88b2a78-6fe4-4681-b9fb-8ae5894ebbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca2e278-e3e6-44d1-8302-872b23dac87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca2e278-e3e6-44d1-8302-872b23dac87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-56364102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449d8416-e082-444c-b293-b8b6e326f2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa6e76dfa45b68e0ef612440ad36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:48Z,use_quota=True,user_id='92d6c87906364e368d513d18a626a713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dd43b2-4806-483b-99a9-f5d16fb9fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dd43b2-4806-483b-99a9-f5d16fb9fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30de66c6-1b19-48a1-adc1-b920a0343dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30de66c6-1b19-48a1-adc1-b920a0343dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449d8416-e082-444c-b293-b8b6e326f2c6', 'volume_name': 'volume-449d8416-e082-444c-b293-b8b6e326f2c6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dc8f6c-5369-415f-af46-e510c37b1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dc8f6c-5369-415f-af46-e510c37b1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64069002-319a-4e90-be44-d631622a28cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:48 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Volume 449d8416-e082-444c-b293-b8b6e326f2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449d8416-e082-444c-b293-b8b6e326f2c6', 'volume_size': 1} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-56364102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449d8416-e082-444c-b293-b8b6e326f2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa6e76dfa45b68e0ef612440ad36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:48Z,use_quota=True,user_id='92d6c87906364e368d513d18a626a713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Creating volume 449d8416-e082-444c-b293-b8b6e326f2c6 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:48 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:48 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:48 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 1073741824 Nov 03 17:11:48 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:48 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775" returned: 0 in 0.456s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775 Nov 03 17:11:48 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:48 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 1073741824" returned: 0 in 0.549s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775" returned: 0 in 0.282s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:48 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 Nov 03 17:11:48 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-quobyte-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775" released by "delete_volume" :: held 0.787s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Created reservations ['5126b92a-3dd9-430a-8966-93315919adb5', '0b9bbbd0-1cca-40ff-bde4-7d7f9b197987', 'f9ffd89c-f775-42ba-8a36-e1748ff54c04', 'ff2a03fc-2e7a-4169-98e1-835e67f8f190'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:48 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:49 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6" returned: 0 in 0.341s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64069002-319a-4e90-be44-d631622a28cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449d8416-e082-444c-b293-b8b6e326f2c6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce106007-2e95-4963-a351-c79232fa77bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:49 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Volume volume-449d8416-e082-444c-b293-b8b6e326f2c6 (449d8416-e082-444c-b293-b8b6e326f2c6): created successfully Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce106007-2e95-4963-a351-c79232fa77bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Flow 'volume_create_manager' (f88b2a78-6fe4-4681-b9fb-8ae5894ebbda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-bd64ae47-6b24-4e68-91ab-784e4d856ce9 tempest-ProjectReaderTests-1049531057 None] Created volume successfully. Nov 03 17:11:49 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.296s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Deleted volume successfully. Nov 03 17:11:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f5b15fab-f802-444a-a5e6-2d1ab349250b tempest-CreateVolumesFromImageTest-1420797376 None] Lock "cinder-4062ebb2-b6d0-4ecc-8aaa-ac45f4bad775-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Acquiring lock "cinder-449d8416-e082-444c-b293-b8b6e326f2c6-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Lock "cinder-449d8416-e082-444c-b293-b8b6e326f2c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Acquiring lock "cinder-quobyte-449d8416-e082-444c-b293-b8b6e326f2c6" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Lock "cinder-quobyte-449d8416-e082-444c-b293-b8b6e326f2c6" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:50 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dedeb56-c30b-4bce-a2d3-8d1a29bc7522]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:50 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 Nov 03 17:11:50 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:50 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6" returned: 0 in 0.428s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:50 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6 Nov 03 17:11:50 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:51 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-449d8416-e082-444c-b293-b8b6e326f2c6" returned: 0 in 0.327s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Lock "cinder-quobyte-449d8416-e082-444c-b293-b8b6e326f2c6" released by "delete_volume" :: held 0.816s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Created reservations ['910af4e2-40ef-4d2b-bab7-b5b3666653b6', '319455ac-4491-4a4e-969b-919a2eafafa6', '9a970535-43d0-4404-92a5-c002bfb42294', '5c90be68-2223-496b-bf1b-ac6a1b4b316e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:51 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:51 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:51 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.399s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:51 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Deleted volume successfully. Nov 03 17:11:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7591ca45-06b8-4efd-9952-5f1a9357ff0c tempest-ProjectReaderTests-1049531057 None] Lock "cinder-449d8416-e082-444c-b293-b8b6e326f2c6-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Flow 'volume_create_manager' (84344612-a3a0-46a7-9469-5eea2df3668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1949af0a-6daf-4b35-9874-73089605456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1949af0a-6daf-4b35-9874-73089605456d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062935149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa6e76dfa45b68e0ef612440ad36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:52Z,use_quota=True,user_id='92d6c87906364e368d513d18a626a713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9089b7d9-60ac-41de-9415-d2883a3e2cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9089b7d9-60ac-41de-9415-d2883a3e2cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa0354a-8c95-46f3-98fd-fbc43c4d7261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa0354a-8c95-46f3-98fd-fbc43c4d7261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528', 'volume_name': 'volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceeadd0-0b6c-429a-b4dd-3cacbaceeccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceeadd0-0b6c-429a-b4dd-3cacbaceeccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c27430-fd2c-4464-b0a5-0e67fea29465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:52 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Volume c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528', 'volume_size': 1} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062935149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eaa6e76dfa45b68e0ef612440ad36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:52Z,use_quota=True,user_id='92d6c87906364e368d513d18a626a713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Creating volume c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:52 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:52 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 1073741824 Nov 03 17:11:52 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:52 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 1073741824" returned: 0 in 0.533s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:52 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 Nov 03 17:11:52 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:52 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528" returned: 0 in 0.283s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c27430-fd2c-4464-b0a5-0e67fea29465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fad3d5-1807-4f6d-b0af-738df610809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Volume volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 (c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528): created successfully Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fad3d5-1807-4f6d-b0af-738df610809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Flow 'volume_create_manager' (84344612-a3a0-46a7-9469-5eea2df3668a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:53 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f89f3fe8-2801-41f8-b20d-eb376affd7f0 tempest-ProjectReaderTests-1049531057 None] Created volume successfully. Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (6721beae-df10-4f70-be46-af743cab181f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7a89aa-4df2-4a3f-9bdb-6e1b3c9ad4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7a89aa-4df2-4a3f-9bdb-6e1b3c9ad4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370375947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a70ce5a-0129-4802-8c72-5e5bcbe353a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:53Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2736fc-8a06-4471-b815-5c1486118532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2736fc-8a06-4471-b815-5c1486118532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961baddd-27a5-40e3-9c47-b4ae720f6ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961baddd-27a5-40e3-9c47-b4ae720f6ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a70ce5a-0129-4802-8c72-5e5bcbe353a4', 'volume_name': 'volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ef9907-17b1-4d73-8d9c-e44724f2459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ef9907-17b1-4d73-8d9c-e44724f2459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561000bb-8a59-42f3-aa4f-432d242238e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume 4a70ce5a-0129-4802-8c72-5e5bcbe353a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4', 'volume_size': 1} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370375947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a70ce5a-0129-4802-8c72-5e5bcbe353a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:53Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Creating volume 4a70ce5a-0129-4802-8c72-5e5bcbe353a4 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:53 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:53 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 1073741824 Nov 03 17:11:53 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:53 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 1073741824" returned: 0 in 0.431s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:53 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 Nov 03 17:11:53 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:53 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" returned: 0 in 0.271s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561000bb-8a59-42f3-aa4f-432d242238e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d7b752-508d-49f6-b1cb-87cfce4e5307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 (4a70ce5a-0129-4802-8c72-5e5bcbe353a4): created successfully Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d7b752-508d-49f6-b1cb-87cfce4e5307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (6721beae-df10-4f70-be46-af743cab181f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:53 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ec1a8581-460f-49bb-94f1-d4abc0e4a740 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created volume successfully. Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "cinder-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Lock "cinder-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "cinder-quobyte-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Lock "cinder-quobyte-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5f2899-f851-4b22-920f-6305e13ae711]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:54 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 Nov 03 17:11:54 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:54 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528" returned: 0 in 0.404s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:54 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528 Nov 03 17:11:54 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:54 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528" returned: 0 in 0.273s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Lock "cinder-quobyte-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528" released by "delete_volume" :: held 0.729s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:54 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Created reservations ['f9c68ade-c9f8-471e-afca-690fda1895f5', '0e67ed66-c7e3-4347-a7cd-1af92c6c838c', '965394a5-f991-4c8d-b5cd-be7d28c560b2', '1febb72c-85d7-4344-b9bf-a9c13ed6b4f6'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:55 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:11:55 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:55 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.327s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:55 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Deleted volume successfully. Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06391f28-cdfd-465d-b6d9-f84dc5270e32 tempest-ProjectReaderTests-1049531057 None] Lock "cinder-c0a9c6c7-cf71-42c3-ab9f-8f7ceee37528-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Flow 'volume_create_manager' (107f55ac-4dd3-4aa3-9d63-10fae9a4d71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf18c023-2b0a-420b-bcd1-c16709416f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Creating offline snapshot 1cd25238-467f-4cd3-8946-376e8137c4f9 of volume 4a70ce5a-0129-4802-8c72-5e5bcbe353a4 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf18c023-2b0a-420b-bcd1-c16709416f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9dcae5-dba9-44c3-88b7-eb402a8d71b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2297bd0c8b6044e0b0e8f2365a9cbb14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:55Z,use_quota=True,user_id='28b333466de24483bf6ffb8fb3356e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4417407-693d-4e6d-aecb-b7f33ecf099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4417407-693d-4e6d-aecb-b7f33ecf099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39812fa3-7cd4-42b9-9ebd-05c0e4c06fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b00049-b013-49e9-9a80-ab96a45e8834]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:55 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 Nov 03 17:11:55 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:56 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" returned: 0 in 0.426s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:56 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 1G Nov 03 17:11:56 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39812fa3-7cd4-42b9-9ebd-05c0e4c06fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b9dcae5-dba9-44c3-88b7-eb402a8d71b3', 'volume_name': 'volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3', 'volume_size': 1, 'image_id': '3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '82126ea7baadf015dd2b51dd86df3666', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2297bd0c8b6044e0b0e8f2365a9cbb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66d2af84245aa4f9704bf0e2e7980ffde8590723c087566c6f226e43ae6c3dfea90a29c0c59533a8e6a9f2aea33627ef84b098b69ebe23c24846bece9d7220f9', 'id': '3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'created_at': datetime.datetime(2026, 11, 3, 16, 11, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 11, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7/file', 'properties': {}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f1e76b-41d1-4043-ac39-6f1a55c33055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f1e76b-41d1-4043-ac39-6f1a55c33055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d1bd0c-b1fe-4bb3-a46a-df99b95a7e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:56 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Volume 5b9dcae5-dba9-44c3-88b7-eb402a8d71b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3', 'volume_size': 1, 'image_id': '3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '82126ea7baadf015dd2b51dd86df3666', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2297bd0c8b6044e0b0e8f2365a9cbb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66d2af84245aa4f9704bf0e2e7980ffde8590723c087566c6f226e43ae6c3dfea90a29c0c59533a8e6a9f2aea33627ef84b098b69ebe23c24846bece9d7220f9', 'id': '3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'created_at': datetime.datetime(2026, 11, 3, 16, 11, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 11, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7/file', 'properties': {}}, 'image_service': } Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Trying to clone 5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 from image 3f3482bd-aa65-4db7-aff1-07a338c32ad7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:11:56 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e159ccc-e9ef-4d82-897f-e4f41190c209]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:56 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD Nov 03 17:11:56 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:56 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 1G" returned: 0 in 0.545s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:56 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 Nov 03 17:11:56 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:56 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:56 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD Nov 03 17:11:56 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:56 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9" returned: 0 in 0.387s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:56 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 is being set with open permissions: ugo+rw Nov 03 17:11:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:57 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 Nov 03 17:11:57 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:57 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Temporary image 3f3482bd-aa65-4db7-aff1-07a338c32ad7 is fetched for user 28b333466de24483bf6ffb8fb3356e40. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab2d6e7-07de-4b73-8555-3d2d6de69b2c]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:57 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9" returned: 0 in 0.285s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD Nov 03 17:11:57 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:57 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.info Nov 03 17:11:57 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:57 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:57 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.info" returned: 0 in 0.313s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.info is being set with open permissions: ugo+rw Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:57 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.info Nov 03 17:11:57 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:57 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD Nov 03 17:11:57 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:57 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.info" returned: 0 in 0.269s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:57 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9dcae5-dba9-44c3-88b7-eb402a8d71b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2297bd0c8b6044e0b0e8f2365a9cbb14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:55Z,use_quota=True,user_id='28b333466de24483bf6ffb8fb3356e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Creating volume 5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:57 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:58 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3774accc-ea5f-41ab-b647-20a6d958a39b tempest-CreateVolumesFromSnapshotTest-546910464 None] Create snapshot completed successfully Nov 03 17:11:58 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 1073741824 Nov 03 17:11:58 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:58 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 1073741824" returned: 0 in 0.443s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:58 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 Nov 03 17:11:58 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:58 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3" returned: 0 in 0.280s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:58 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Attempting download of 3f3482bd-aa65-4db7-aff1-07a338c32ad7 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'metadata': {}}])) to volume 5b9dcae5-dba9-44c3-88b7-eb402a8d71b3. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:11:58 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be8ea1-830c-4d04-b7f6-4b172951fec9]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f3482bd-aa65-4db7-aff1-07a338c32ad7_6diqnul7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:58 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f3482bd-aa65-4db7-aff1-07a338c32ad7_6diqnul7 Nov 03 17:11:58 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (306dcaf7-2b30-4241-8ecf-8bcee88b34be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e554c49e-7df7-45e9-afc3-85bad56bd73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e554c49e-7df7-45e9-afc3-85bad56bd73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1990829912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:59Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93c07dc-755f-4eff-a76e-f0d0ae9fa7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93c07dc-755f-4eff-a76e-f0d0ae9fa7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7f1842-a0f3-4201-be09-64545b75193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7f1842-a0f3-4201-be09-64545b75193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5', 'volume_name': 'volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05659e2a-bd91-4fa9-ab49-4a03134d0b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05659e2a-bd91-4fa9-ab49-4a03134d0b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d7b041-90f2-4480-95d7-22165bdf5264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5', 'volume_size': 1} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1990829912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:59Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Creating volume e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:59 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:59 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f3482bd-aa65-4db7-aff1-07a338c32ad7_6diqnul7" returned: 0 in 0.357s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f3482bd-aa65-4db7-aff1-07a338c32ad7_6diqnul7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:59 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 1073741824 Nov 03 17:11:59 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:59 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f3482bd-aa65-4db7-aff1-07a338c32ad7_6diqnul7 Nov 03 17:11:59 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (d66112eb-63b5-4601-8d17-5310cadb7a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59645ae-4b2c-45e1-b6ed-86bf2048acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59645ae-4b2c-45e1-b6ed-86bf2048acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832312511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6864342f-6c94-48b3-8d36-5ad89cd0b719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:59Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac99359d-67a5-4b10-b8c4-965d284096da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac99359d-67a5-4b10-b8c4-965d284096da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a459b9-ecab-4e32-a1f2-251ad2a7a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a459b9-ecab-4e32-a1f2-251ad2a7a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6864342f-6c94-48b3-8d36-5ad89cd0b719', 'volume_name': 'volume-6864342f-6c94-48b3-8d36-5ad89cd0b719', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2812b5-789f-4b3c-b55c-4e2805205ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2812b5-789f-4b3c-b55c-4e2805205ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30824c44-8023-49da-a411-2dce5fd1f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume 6864342f-6c94-48b3-8d36-5ad89cd0b719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6864342f-6c94-48b3-8d36-5ad89cd0b719', 'volume_size': 1} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f3482bd-aa65-4db7-aff1-07a338c32ad7_6diqnul7" returned: 1 in 0.434s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f3482bd-aa65-4db7-aff1-07a338c32ad7_6diqnul7' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da69da3-b40e-4add-8528-14bc68a2a003]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:59 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 1073741824" returned: 0 in 0.591s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:59 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD Nov 03 17:11:59 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:59 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 Nov 03 17:11:59 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (a950862c-9674-4a71-86c4-d1776500d112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eaa0aef-9337-44de-b5de-35701628806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eaa0aef-9337-44de-b5de-35701628806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248454510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:00Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d159b8-d917-49fe-a7b0-a0cd3dcd6f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d159b8-d917-49fe-a7b0-a0cd3dcd6f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4087783-c920-4189-a21e-747f082287a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4087783-c920-4189-a21e-747f082287a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e', 'volume_name': 'volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9981e0-f093-4356-8a1b-27f1fd294085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9981e0-f093-4356-8a1b-27f1fd294085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9ec433-3174-49e8-ae8c-29e24eed625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume 4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e', 'volume_size': 1} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:00 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:00 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5" returned: 0 in 0.340s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.523s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832312511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6864342f-6c94-48b3-8d36-5ad89cd0b719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:59Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Creating volume 6864342f-6c94-48b3-8d36-5ad89cd0b719 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:00 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:00 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:00 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d7b041-90f2-4480-95d7-22165bdf5264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980daa7c-c6cc-4b51-8e50-2844a2c72d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 1073741824 Nov 03 17:12:00 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:00 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 (e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5): created successfully Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980daa7c-c6cc-4b51-8e50-2844a2c72d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (306dcaf7-2b30-4241-8ecf-8bcee88b34be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-15a1bba6-f504-42e3-9965-dff727d54ebc tempest-CreateVolumesFromSnapshotTest-546910464 None] Created volume successfully. Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (41489a2a-ad4f-4dff-8957-c7b24b3997ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096a3f0d-1e44-4189-9b09-d0f41261cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096a3f0d-1e44-4189-9b09-d0f41261cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-310000576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e891618-7f3c-4052-8b37-83033dfc6d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:00Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbd765a-bc31-4706-9ede-6421f19c119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbd765a-bc31-4706-9ede-6421f19c119f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a1a78-6ca4-407e-9b57-e90c06aa8564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a1a78-6ca4-407e-9b57-e90c06aa8564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e891618-7f3c-4052-8b37-83033dfc6d41', 'volume_name': 'volume-7e891618-7f3c-4052-8b37-83033dfc6d41', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa80a483-f1eb-4e75-ac6b-78460ca0d3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa80a483-f1eb-4e75-ac6b-78460ca0d3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399a8dff-ce5c-4dec-bb3c-3606602db195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume 7e891618-7f3c-4052-8b37-83033dfc6d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e891618-7f3c-4052-8b37-83033dfc6d41', 'volume_size': 1} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] 3f3482bd-aa65-4db7-aff1-07a338c32ad7 was raw, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:00 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 Nov 03 17:12:00 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:00 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (e6a7ac8a-43cc-4006-b54c-fdbaa5484f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c38983-ab27-465d-891f-b1aacd2ff929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 1073741824" returned: 0 in 0.644s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c38983-ab27-465d-891f-b1aacd2ff929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-136386622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ce9943-8ae9-4cf0-ae21-993fb6850ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:01Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211f0636-adf3-4daa-aea9-379aacce6cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211f0636-adf3-4daa-aea9-379aacce6cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3c19a4-6a2e-4da6-afb5-ea2cbb0c0cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3c19a4-6a2e-4da6-afb5-ea2cbb0c0cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ce9943-8ae9-4cf0-ae21-993fb6850ff9', 'volume_name': 'volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdfcea9-0d96-4abe-bdcb-8edef30fee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdfcea9-0d96-4abe-bdcb-8edef30fee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0777a6-15db-48ac-94ba-4d363ff839bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:00 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume 23ce9943-8ae9-4cf0-ae21-993fb6850ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9', 'volume_size': 1} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:00 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 Nov 03 17:12:00 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:01 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3" returned: 0 in 0.559s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f3482bd-aa65-4db7-aff1-07a338c32ad7_k0hakf9jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:01 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 1G Nov 03 17:12:01 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:01 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719" returned: 0 in 0.263s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.127s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248454510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:00Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Creating volume 4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30824c44-8023-49da-a411-2dce5fd1f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6864342f-6c94-48b3-8d36-5ad89cd0b719', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:01 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e 1073741824 Nov 03 17:12:01 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f921c87-4a9d-4047-afc4-ea9811ebe54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 (6864342f-6c94-48b3-8d36-5ad89cd0b719): created successfully Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f921c87-4a9d-4047-afc4-ea9811ebe54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (d66112eb-63b5-4601-8d17-5310cadb7a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-fb637bfb-20d4-41cd-8971-6ecc43539dc9 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created volume successfully. Nov 03 17:12:01 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 1G" returned: 0 in 0.330s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Downloaded image 3f3482bd-aa65-4db7-aff1-07a338c32ad7 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'metadata': {}}])) to volume 5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Temporary image 3f3482bd-aa65-4db7-aff1-07a338c32ad7 for user 28b333466de24483bf6ffb8fb3356e40 is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Marking volume 5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=162,cinder:UPDATE=225,cinder:INSERT=61,cinder:DELETE=18 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Copying metadata from image 3f3482bd-aa65-4db7-aff1-07a338c32ad7 to 5b9dcae5-dba9-44c3-88b7-eb402a8d71b3. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Creating volume glance metadata for volume 5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 backed by image 3f3482bd-aa65-4db7-aff1-07a338c32ad7 with: {'image_id': '3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '82126ea7baadf015dd2b51dd86df3666', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d1bd0c-b1fe-4bb3-a46a-df99b95a7e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3', 'volume_size': 1, 'image_id': '3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '82126ea7baadf015dd2b51dd86df3666', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2297bd0c8b6044e0b0e8f2365a9cbb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66d2af84245aa4f9704bf0e2e7980ffde8590723c087566c6f226e43ae6c3dfea90a29c0c59533a8e6a9f2aea33627ef84b098b69ebe23c24846bece9d7220f9', 'id': '3f3482bd-aa65-4db7-aff1-07a338c32ad7', 'created_at': datetime.datetime(2026, 11, 3, 16, 11, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 11, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f3482bd-aa65-4db7-aff1-07a338c32ad7/file', 'properties': {}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0052957-d823-47fe-8732-3b239568edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Volume volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 (5b9dcae5-dba9-44c3-88b7-eb402a8d71b3): created successfully Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0052957-d823-47fe-8732-3b239568edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Flow 'volume_create_manager' (107f55ac-4dd3-4aa3-9d63-10fae9a4d71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-63657063-b90a-4338-9a07-5abcfa5e6c7d tempest-VolumeImageDependencyTests-581085009 None] Created volume successfully. Nov 03 17:12:01 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e 1073741824" returned: 0 in 0.434s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:01 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e Nov 03 17:12:01 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:01 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e" returned: 0 in 0.256s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-310000576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e891618-7f3c-4052-8b37-83033dfc6d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:00Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Creating volume 7e891618-7f3c-4052-8b37-83033dfc6d41 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:01 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 1073741824 Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9ec433-3174-49e8-ae8c-29e24eed625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:01 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4dcd02-a4c8-4df3-9a77-381468fab5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e (4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e): created successfully Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4dcd02-a4c8-4df3-9a77-381468fab5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (a950862c-9674-4a71-86c4-d1776500d112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0452dfff-84af-4307-96cc-440bec616914 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created volume successfully. Nov 03 17:12:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Acquiring lock "cinder-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Lock "cinder-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Acquiring lock "cinder-quobyte-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Lock "cinder-quobyte-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79129eb-09c4-4227-8c9a-61e23f8a7932]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:02 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 Nov 03 17:12:02 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:02 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 1073741824" returned: 0 in 0.464s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:02 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 Nov 03 17:12:02 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:02 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3" returned: 0 in 0.405s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:02 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3 Nov 03 17:12:02 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:02 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41" returned: 0 in 0.273s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-136386622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ce9943-8ae9-4cf0-ae21-993fb6850ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6890a121d1145e28821979988a5562f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:01Z,use_quota=True,user_id='fdf58acbc6f54f2ebdf40b8c30338f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Creating volume 23ce9943-8ae9-4cf0-ae21-993fb6850ff9 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:02 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:02 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 1073741824 Nov 03 17:12:02 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399a8dff-ce5c-4dec-bb3c-3606602db195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e891618-7f3c-4052-8b37-83033dfc6d41', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18164c19-b326-4965-88ca-1b02e2e98a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:02 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume volume-7e891618-7f3c-4052-8b37-83033dfc6d41 (7e891618-7f3c-4052-8b37-83033dfc6d41): created successfully Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18164c19-b326-4965-88ca-1b02e2e98a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:02 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (41489a2a-ad4f-4dff-8957-c7b24b3997ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3" returned: 0 in 0.279s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:02 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3d1d73c4-bdf9-4ff5-a9ea-2e4a495cdf66 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created volume successfully. Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Lock "cinder-quobyte-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3" released by "delete_volume" :: held 0.741s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Created reservations ['254a26b7-0982-43c8-8c92-9450deea9291', '4b792331-0a8a-4a74-a5ac-351bb6fe6b0f', 'd06fa185-1ed8-4ad4-a18a-d563ef78b721', '109ca37d-4f02-4707-89ff-916fb22c46e3'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:03 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:03 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:03 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.321s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:03 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Deleted volume successfully. Nov 03 17:12:03 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 1073741824" returned: 0 in 0.625s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8e1090b-36ec-4251-8653-ddf19cc03c95 tempest-VolumeImageDependencyTests-581085009 None] Lock "cinder-5b9dcae5-dba9-44c3-88b7-eb402a8d71b3-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:03 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 Nov 03 17:12:03 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:03 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9" returned: 0 in 0.253s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0777a6-15db-48ac-94ba-4d363ff839bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d04b188-cea8-4bfb-b78e-ecfe8054ca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:03 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Volume volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 (23ce9943-8ae9-4cf0-ae21-993fb6850ff9): created successfully Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d04b188-cea8-4bfb-b78e-ecfe8054ca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Flow 'volume_create_manager' (e6a7ac8a-43cc-4006-b54c-fdbaa5484f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:03 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1a2a9d0a-7061-496d-bdd9-e5d10b9cc40f tempest-CreateVolumesFromSnapshotTest-546910464 None] Created volume successfully. Nov 03 17:12:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-23ce9943-8ae9-4cf0-ae21-993fb6850ff9-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-23ce9943-8ae9-4cf0-ae21-993fb6850ff9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-quobyte-23ce9943-8ae9-4cf0-ae21-993fb6850ff9" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-23ce9943-8ae9-4cf0-ae21-993fb6850ff9" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca0c14-0871-4be9-a527-983136e71aa9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:04 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 Nov 03 17:12:04 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:04 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9" returned: 0 in 0.406s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:04 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9 Nov 03 17:12:04 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:05 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-23ce9943-8ae9-4cf0-ae21-993fb6850ff9" returned: 0 in 0.352s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-23ce9943-8ae9-4cf0-ae21-993fb6850ff9" released by "delete_volume" :: held 0.809s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created reservations ['a03a086b-88bb-4fb7-b943-dc9373f6d1cc', 'ed14f675-800d-4b95-b4f2-eb048ca956ea', '813bd5e2-82f7-40ca-a5a3-39d6cee7b04a', 'a7698371-e3d2-4355-9b1b-684bd2a1c48e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:05 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:05 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-7e891618-7f3c-4052-8b37-83033dfc6d41-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-7e891618-7f3c-4052-8b37-83033dfc6d41-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-quobyte-7e891618-7f3c-4052-8b37-83033dfc6d41" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-7e891618-7f3c-4052-8b37-83033dfc6d41" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:05 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2e737-0f19-485f-8e26-17bd44c4380a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.322s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Deleted volume successfully. Nov 03 17:12:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3fcb68bf-1e55-4c47-b02c-0753273e7cb3 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-23ce9943-8ae9-4cf0-ae21-993fb6850ff9-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:05 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 Nov 03 17:12:05 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:06 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41" returned: 0 in 0.438s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:06 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41 Nov 03 17:12:06 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:06 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7e891618-7f3c-4052-8b37-83033dfc6d41" returned: 0 in 0.257s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-7e891618-7f3c-4052-8b37-83033dfc6d41" released by "delete_volume" :: held 0.757s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created reservations ['9802e1d4-9b2f-4d1f-82a9-fa7f9573113b', '0118f77b-463f-470a-b191-f2d2a72fd7ad', '9c4d0474-6b13-4765-9d4f-a91e6b397f3d', '566c477e-a67d-4815-823c-d67fdee288e1'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:06 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:06 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-quobyte-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:06 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Deleted volume successfully. Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab735a-6788-44ff-b7ad-995b66fcf4b8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-06b42caf-4d05-4524-a246-29630faab397 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-7e891618-7f3c-4052-8b37-83033dfc6d41-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:06 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e Nov 03 17:12:06 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:07 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:07 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e Nov 03 17:12:07 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:07 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e" returned: 0 in 0.276s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e" released by "delete_volume" :: held 0.752s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created reservations ['e6d38e6f-67e4-428d-8943-162dbac62eb7', '73e0b3bc-4286-42ee-8e52-1267dc76f645', 'a8c22c91-78c7-4ad3-a42f-913f34b9395d', 'd227950f-018e-4099-96a8-d52e905e97b8'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:07 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:07 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-6864342f-6c94-48b3-8d36-5ad89cd0b719-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-6864342f-6c94-48b3-8d36-5ad89cd0b719-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-quobyte-6864342f-6c94-48b3-8d36-5ad89cd0b719" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-6864342f-6c94-48b3-8d36-5ad89cd0b719" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b94fa-08f1-455f-ab53-0d9ac7bb7e2a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:08 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.332s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Deleted volume successfully. Nov 03 17:12:08 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 Nov 03 17:12:08 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-04a9d433-b28b-4d18-85c4-407913023245 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-4fca79fd-cb7f-48f1-8eca-e8fe3ca5eb5e-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:08 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719" returned: 0 in 0.417s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:08 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719 Nov 03 17:12:08 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:08 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6864342f-6c94-48b3-8d36-5ad89cd0b719" returned: 0 in 0.305s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-6864342f-6c94-48b3-8d36-5ad89cd0b719" released by "delete_volume" :: held 0.774s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created reservations ['8c9a6b7d-69e3-49b4-87fe-73c277d207ef', '33dea8b3-2ebb-4de1-a0eb-028587a652b0', '37285ab8-73b4-4a3c-954c-72e0f447f1ff', 'f556ece8-fca1-4515-9f77-165251afc122'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:09 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:09 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:09 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.272s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:09 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Deleted volume successfully. Nov 03 17:12:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bc9432a8-fb51-4248-ade2-91a4ce9da8e8 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-6864342f-6c94-48b3-8d36-5ad89cd0b719-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-quobyte-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5" acquired by "delete_volume" :: waited 0.038s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6215e8c-7bd9-4166-9838-b72c2bdbc3ba]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:15 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 Nov 03 17:12:15 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:15 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5" returned: 0 in 0.420s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:15 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5 Nov 03 17:12:15 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:15 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5" returned: 0 in 0.315s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5" released by "delete_volume" :: held 0.799s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=177,cinder:INSERT=63,cinder:UPDATE=249,cinder:DELETE=23 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created reservations ['559b5481-2e6f-4d1d-9427-ec39725615df', 'f2d8496f-b9bb-4b97-ab15-ca515faa8b3a', '0b4f2160-5d32-4c55-819f-214d37591de4', 'ee1d4b0a-02af-4524-b2c0-740229d2a600'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:15 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:15 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:16 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.280s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Deleted volume successfully. Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-545ddf70-5650-41f2-ab06-69849a4a9ef2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-e2ff9b66-5f10-438d-bfd7-a6badf1ce4c5-delete_volume" released by "delete_volume" :: held 4.816s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-1cd25238-467f-4cd3-8946-376e8137c4f9-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-1cd25238-467f-4cd3-8946-376e8137c4f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-quobyte-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-quobyte-1cd25238-467f-4cd3-8946-376e8137c4f9" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-1cd25238-467f-4cd3-8946-376e8137c4f9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Deleting offline snapshot 1cd25238-467f-4cd3-8946-376e8137c4f9 of volume 4a70ce5a-0129-4802-8c72-5e5bcbe353a4 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] snapshot_file for this snap is: volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b8d573-7cd1-43bc-86c1-2a4f2819d490]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:16 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 Nov 03 17:12:16 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:17 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9" returned: 0 in 0.380s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:12:17 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae383cff-92e7-48d7-b88c-fc63ae76ad40]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:17 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 Nov 03 17:12:17 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:17 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" returned: 0 in 0.361s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:17 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 Nov 03 17:12:17 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:17 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9" returned: 0 in 0.356s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:18 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9 Nov 03 17:12:18 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:18 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4.1cd25238-467f-4cd3-8946-376e8137c4f9" returned: 0 in 0.264s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-1cd25238-467f-4cd3-8946-376e8137c4f9" released by "_delete_snapshot" :: held 1.499s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" released by "delete_snapshot" :: held 1.524s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:18 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created reservations ['9f2aace0-6c3c-4701-8deb-088d64b19f2d', '50ea40a5-f642-4cef-bb47-edc98f00be34', '362f4e4f-1b6a-42e1-abe6-8a2e24b01d30', 'baaec349-956c-4ce5-a2e7-a386c53cd8cc'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:18 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Delete snapshot completed successfully. Nov 03 17:12:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5376b8a0-1e1d-4ba9-bd00-2f8673aed538 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-1cd25238-467f-4cd3-8946-376e8137c4f9-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-4a70ce5a-0129-4802-8c72-5e5bcbe353a4-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-4a70ce5a-0129-4802-8c72-5e5bcbe353a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "cinder-quobyte-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[212beb42-5c7b-4bfe-a553-8d6c9e6fd4f2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:19 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 Nov 03 17:12:19 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:19 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" returned: 0 in 0.419s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:19 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4 Nov 03 17:12:19 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:19 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" returned: 0 in 0.254s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-quobyte-4a70ce5a-0129-4802-8c72-5e5bcbe353a4" released by "delete_volume" :: held 0.746s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Created reservations ['afc66939-0a89-42ee-8a2f-64fd524644a2', 'fe206180-00f9-4e9b-a3d0-602c5758ba4f', '417df515-d74e-45b0-b55e-9b86e5e638b9', '347540dc-e83a-440f-be43-92b907faaf6d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:19 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:19 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:20 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.269s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:20 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Deleted volume successfully. Nov 03 17:12:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ddb9e094-ac90-48aa-8f45-870dc5bf6dc2 tempest-CreateVolumesFromSnapshotTest-546910464 None] Lock "cinder-4a70ce5a-0129-4802-8c72-5e5bcbe353a4-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Flow 'volume_create_manager' (7e49fa1c-a8bf-4b41-adff-c1d3555be96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fce3f67-e560-4764-8b5a-cf6813f9cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fce3f67-e560-4764-8b5a-cf6813f9cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1683352172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2397772-237c-4a03-a72e-a246c403094e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a30b342f4a498ca641e4bb4b0990c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:23Z,use_quota=True,user_id='b544d81cd2ae4fc98a669e0cad6dd458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf79109-d92c-43bc-863b-e80671d8a264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf79109-d92c-43bc-863b-e80671d8a264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0920eb66-ace4-4912-9f4b-866f765e439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0920eb66-ace4-4912-9f4b-866f765e439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2397772-237c-4a03-a72e-a246c403094e', 'volume_name': 'volume-d2397772-237c-4a03-a72e-a246c403094e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9732a737-1ce9-456a-84dc-6493496ea746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9732a737-1ce9-456a-84dc-6493496ea746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3f9754-2695-4c2b-a38b-75b39d06a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Volume d2397772-237c-4a03-a72e-a246c403094e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2397772-237c-4a03-a72e-a246c403094e', 'volume_size': 1} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1683352172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2397772-237c-4a03-a72e-a246c403094e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a30b342f4a498ca641e4bb4b0990c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:23Z,use_quota=True,user_id='b544d81cd2ae4fc98a669e0cad6dd458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Creating volume d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:23 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:12:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:23 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e 1073741824 Nov 03 17:12:23 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:24 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e 1073741824" returned: 0 in 0.511s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:24 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e Nov 03 17:12:24 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:24 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e" returned: 0 in 0.310s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3f9754-2695-4c2b-a38b-75b39d06a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2397772-237c-4a03-a72e-a246c403094e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36d31fe-e3fa-465c-857c-b5c313007375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:24 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Volume volume-d2397772-237c-4a03-a72e-a246c403094e (d2397772-237c-4a03-a72e-a246c403094e): created successfully Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36d31fe-e3fa-465c-857c-b5c313007375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:24 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Flow 'volume_create_manager' (7e49fa1c-a8bf-4b41-adff-c1d3555be96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-796ef19f-4b1c-4712-b2cd-c4471ebc9a91 tempest-VolumeDependencyTests-1942909085 None] Created volume successfully. Nov 03 17:12:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Creating offline snapshot f5256941-fd65-434d-8a97-e68f0b41093e of volume d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:12:25 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9b69f-8681-42a8-9f4f-48672653759f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e Nov 03 17:12:25 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:26 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e" returned: 0 in 0.416s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:26 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e 1G Nov 03 17:12:26 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:26 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e 1G" returned: 0 in 0.476s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2397772-237c-4a03-a72e-a246c403094e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:26 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2397772-237c-4a03-a72e-a246c403094e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e Nov 03 17:12:26 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:27 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2397772-237c-4a03-a72e-a246c403094e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e" returned: 0 in 0.349s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:27 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e is being set with open permissions: ugo+rw Nov 03 17:12:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:27 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e Nov 03 17:12:27 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:27 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e" returned: 0 in 0.281s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:27 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.info Nov 03 17:12:27 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:27 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.info" returned: 0 in 0.310s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:27 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.info is being set with open permissions: ugo+rw Nov 03 17:12:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:27 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.info Nov 03 17:12:27 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:27 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.info" returned: 0 in 0.270s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.210s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-61a43a0a-efa4-4732-941a-8b18af5771fd tempest-VolumeDependencyTests-1942909085 None] Create snapshot completed successfully Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Flow 'volume_create_manager' (beb4e9c5-71d9-4651-9eec-9e090b4e351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b8ea73-9c71-46f7-848b-553b2a8daa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b8ea73-9c71-46f7-848b-553b2a8daa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-710915547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef570eb-c960-4326-94bf-ed671eb06895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a30b342f4a498ca641e4bb4b0990c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5256941-fd65-434d-8a97-e68f0b41093e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:29Z,use_quota=True,user_id='b544d81cd2ae4fc98a669e0cad6dd458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5ea282-6cf4-43ce-8099-b8ef96220471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5ea282-6cf4-43ce-8099-b8ef96220471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3996c75-6511-4004-b41d-e0070835f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3996c75-6511-4004-b41d-e0070835f13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7ef570eb-c960-4326-94bf-ed671eb06895', 'volume_name': 'volume-7ef570eb-c960-4326-94bf-ed671eb06895', 'volume_size': 1, 'snapshot_id': 'f5256941-fd65-434d-8a97-e68f0b41093e'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e28c632-8246-4e5b-8398-55234342ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e28c632-8246-4e5b-8398-55234342ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b037894-c0c6-4cb0-9342-79006e392b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Volume 7ef570eb-c960-4326-94bf-ed671eb06895: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7ef570eb-c960-4326-94bf-ed671eb06895', 'volume_size': 1, 'snapshot_id': 'f5256941-fd65-434d-8a97-e68f0b41093e'} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-quobyte-f5256941-fd65-434d-8a97-e68f0b41093e-7ef570eb-c960-4326-94bf-ed671eb06895" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-f5256941-fd65-434d-8a97-e68f0b41093e-7ef570eb-c960-4326-94bf-ed671eb06895" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Creating volume 7ef570eb-c960-4326-94bf-ed671eb06895 from snapshot f5256941-fd65-434d-8a97-e68f0b41093e {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-quobyte-7ef570eb-c960-4326-94bf-ed671eb06895" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-7ef570eb-c960-4326-94bf-ed671eb06895" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] snapshot: f5256941-fd65-434d-8a97-e68f0b41093e, volume: 7ef570eb-c960-4326-94bf-ed671eb06895, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29f663-32e5-457b-8642-d8faf9ed0db7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:29 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e Nov 03 17:12:29 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:30 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e" returned: 0 in 0.380s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2397772-237c-4a03-a72e-a246c403094e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e555499-17f1-42e2-adb1-bae35aa92281]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:30 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e Nov 03 17:12:30 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:30 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e" returned: 0 in 0.383s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:30 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 Nov 03 17:12:30 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:30 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:30 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:31 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.602s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:12:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:12:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:12:36 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895" returned: 0 in 6.130s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:36 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:12:36 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Converted 1024.00 MB image at 167.02 MB/s Nov 03 17:12:36 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 is being set with open permissions: ugo+rw Nov 03 17:12:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:36 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 Nov 03 17:12:36 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:36 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895" returned: 0 in 0.280s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:36 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-7ef570eb-c960-4326-94bf-ed671eb06895" released by "_copy_volume_from_snapshot" :: held 7.260s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-f5256941-fd65-434d-8a97-e68f0b41093e-7ef570eb-c960-4326-94bf-ed671eb06895" released by "_create_volume_from_snapshot" :: held 7.324s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.339s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b037894-c0c6-4cb0-9342-79006e392b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef570eb-c960-4326-94bf-ed671eb06895', 'volume_size': 1, 'snapshot_id': 'f5256941-fd65-434d-8a97-e68f0b41093e'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9c915f-92a4-439d-bba9-10df818e21f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:37 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Volume volume-7ef570eb-c960-4326-94bf-ed671eb06895 (7ef570eb-c960-4326-94bf-ed671eb06895): created successfully Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9c915f-92a4-439d-bba9-10df818e21f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Flow 'volume_create_manager' (beb4e9c5-71d9-4651-9eec-9e090b4e351c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3b33d67c-5472-4c57-a05d-894b0682c572 tempest-VolumeDependencyTests-1942909085 None] Created volume successfully. Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-f5256941-fd65-434d-8a97-e68f0b41093e-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-f5256941-fd65-434d-8a97-e68f0b41093e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-quobyte-d2397772-237c-4a03-a72e-a246c403094e" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-d2397772-237c-4a03-a72e-a246c403094e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-quobyte-f5256941-fd65-434d-8a97-e68f0b41093e" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-f5256941-fd65-434d-8a97-e68f0b41093e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Deleting offline snapshot f5256941-fd65-434d-8a97-e68f0b41093e of volume d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] snapshot_file for this snap is: volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbae237-5e69-466a-b1b1-ad0a6e3802fd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:37 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e Nov 03 17:12:37 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:37 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e" returned: 0 in 0.406s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2397772-237c-4a03-a72e-a246c403094e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4656106-ff50-49be-9065-952434d3e3b8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:37 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e Nov 03 17:12:37 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:38 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e" returned: 0 in 0.601s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:38 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e Nov 03 17:12:38 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:38 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e" returned: 0 in 0.356s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:38 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e Nov 03 17:12:38 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:38 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e.f5256941-fd65-434d-8a97-e68f0b41093e" returned: 0 in 0.274s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-f5256941-fd65-434d-8a97-e68f0b41093e" released by "_delete_snapshot" :: held 1.757s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-d2397772-237c-4a03-a72e-a246c403094e" released by "delete_snapshot" :: held 1.780s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Created reservations ['adcd3e63-617b-4c08-9503-2c30c57f2d9b', '60ffa2bc-ce63-49bf-9d22-0e2f1611e25c', '7b8ba728-51eb-4dda-ba20-30756420c1a5', '6622aebc-a370-4a39-a6b9-408b92356858'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Delete snapshot completed successfully. Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-07aa29cd-69a4-4e2e-97e2-ad2801071658 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-f5256941-fd65-434d-8a97-e68f0b41093e-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-d2397772-237c-4a03-a72e-a246c403094e-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-d2397772-237c-4a03-a72e-a246c403094e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-quobyte-d2397772-237c-4a03-a72e-a246c403094e" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-d2397772-237c-4a03-a72e-a246c403094e" acquired by "delete_volume" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e8a02-9ed4-4e7d-83c5-30035e84ec2c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:39 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e Nov 03 17:12:39 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:39 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e" returned: 0 in 0.363s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:39 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e Nov 03 17:12:39 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:40 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2397772-237c-4a03-a72e-a246c403094e" returned: 0 in 0.267s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-d2397772-237c-4a03-a72e-a246c403094e" released by "delete_volume" :: held 0.694s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Created reservations ['d3f977a9-41d4-4f5f-b24e-cfe7c7a327ae', '3611c287-e5bf-4828-9d07-58fd835dbef9', '1a32ff01-7274-4945-b78b-a0129c1cd648', '9fb5d21f-1ee2-411c-a331-145ff608c946'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:40 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:40 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:40 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.258s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:40 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Deleted volume successfully. Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-7ef570eb-c960-4326-94bf-ed671eb06895-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-595db7a9-8ae0-44ce-99e1-de0b3c9d600c tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-d2397772-237c-4a03-a72e-a246c403094e-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-7ef570eb-c960-4326-94bf-ed671eb06895-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "cinder-quobyte-7ef570eb-c960-4326-94bf-ed671eb06895" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-7ef570eb-c960-4326-94bf-ed671eb06895" acquired by "delete_volume" :: waited 0.015s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d347e7c-b992-4e95-8738-ed3917adab47]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:40 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 Nov 03 17:12:40 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:41 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895" returned: 0 in 0.389s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:41 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895 Nov 03 17:12:41 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:41 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7ef570eb-c960-4326-94bf-ed671eb06895" returned: 0 in 0.251s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-quobyte-7ef570eb-c960-4326-94bf-ed671eb06895" released by "delete_volume" :: held 0.686s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Created reservations ['54e59e5e-f311-479b-8d37-96a18bb710cc', 'd6dec8c0-303a-43f4-924f-ae95c6ba5a22', '826fe47f-58a5-4d00-93de-5c90c372b4f0', '7162f2bb-2acf-4660-ab04-0dad6d47a20c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:41 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:41 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:41 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.246s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Deleted volume successfully. Nov 03 17:12:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-926f111d-6cfb-46c8-a652-41ed66c492b8 tempest-VolumeDependencyTests-1942909085 None] Lock "cinder-7ef570eb-c960-4326-94bf-ed671eb06895-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Flow 'volume_create_manager' (a2152567-e72d-42ad-b808-47df5157a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a288e720-aec3-4255-b6a3-828f326a92c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a288e720-aec3-4255-b6a3-828f326a92c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ab90ea-2c4e-457e-813e-4d4b959d3757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc828a0e39947d4a550e594ff5237e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:45Z,use_quota=True,user_id='7b1cae31f34041b3a8efad7b994be320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483f5c18-ebdb-4a88-9bc6-e2f2af0566c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483f5c18-ebdb-4a88-9bc6-e2f2af0566c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a857ad-aad4-47e6-8d90-d2dc561c1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a857ad-aad4-47e6-8d90-d2dc561c1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ab90ea-2c4e-457e-813e-4d4b959d3757', 'volume_name': 'volume-53ab90ea-2c4e-457e-813e-4d4b959d3757', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455f140b-0eb1-4352-919a-952e637a9758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455f140b-0eb1-4352-919a-952e637a9758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedd00b4-d467-4dda-80c6-990b8c004902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:44 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Volume 53ab90ea-2c4e-457e-813e-4d4b959d3757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ab90ea-2c4e-457e-813e-4d4b959d3757', 'volume_size': 1} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ab90ea-2c4e-457e-813e-4d4b959d3757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc828a0e39947d4a550e594ff5237e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:45Z,use_quota=True,user_id='7b1cae31f34041b3a8efad7b994be320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Creating volume 53ab90ea-2c4e-457e-813e-4d4b959d3757 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:44 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:12:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:44 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 1073741824 Nov 03 17:12:44 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:45 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 1073741824" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:45 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 Nov 03 17:12:45 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:45 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757" returned: 0 in 0.231s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedd00b4-d467-4dda-80c6-990b8c004902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ab90ea-2c4e-457e-813e-4d4b959d3757', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba433ce1-ce17-4391-8442-71309b22ab50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:45 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Volume volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 (53ab90ea-2c4e-457e-813e-4d4b959d3757): created successfully Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba433ce1-ce17-4391-8442-71309b22ab50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Flow 'volume_create_manager' (a2152567-e72d-42ad-b808-47df5157a38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5e6328a7-c59a-46a9-a731-428102870953 tempest-CinderUnicodeTest-99327618 None] Created volume successfully. Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Flow 'volume_create_manager' (a11cea79-5f84-4fe0-bfea-2844334f2cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756b877c-2873-445a-b55d-46aca395afff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756b877c-2873-445a-b55d-46aca395afff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1613161806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89ea522-9bc3-41f1-9e63-a4d666383dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc828a0e39947d4a550e594ff5237e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:46Z,use_quota=True,user_id='7b1cae31f34041b3a8efad7b994be320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c638338-835f-456e-bedd-7548d4423032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c638338-835f-456e-bedd-7548d4423032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd259e6a-55de-4166-ad0a-ec17e78d550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd259e6a-55de-4166-ad0a-ec17e78d550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89ea522-9bc3-41f1-9e63-a4d666383dde', 'volume_name': 'volume-b89ea522-9bc3-41f1-9e63-a4d666383dde', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5518230a-51dc-4e6c-9561-9787fe75234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5518230a-51dc-4e6c-9561-9787fe75234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9330d7-8af3-41e2-854a-74eed47c6b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:46 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Volume b89ea522-9bc3-41f1-9e63-a4d666383dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89ea522-9bc3-41f1-9e63-a4d666383dde', 'volume_size': 1} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1613161806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89ea522-9bc3-41f1-9e63-a4d666383dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc828a0e39947d4a550e594ff5237e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:46Z,use_quota=True,user_id='7b1cae31f34041b3a8efad7b994be320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Creating volume b89ea522-9bc3-41f1-9e63-a4d666383dde {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:46 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:46 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde 1073741824 Nov 03 17:12:46 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:46 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde 1073741824" returned: 0 in 0.410s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:46 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde Nov 03 17:12:46 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:46 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde" returned: 0 in 0.255s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9330d7-8af3-41e2-854a-74eed47c6b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89ea522-9bc3-41f1-9e63-a4d666383dde', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d473ff-8695-4a2f-9628-cd3796b91294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:46 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Volume volume-b89ea522-9bc3-41f1-9e63-a4d666383dde (b89ea522-9bc3-41f1-9e63-a4d666383dde): created successfully Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d473ff-8695-4a2f-9628-cd3796b91294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:46 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Flow 'volume_create_manager' (a11cea79-5f84-4fe0-bfea-2844334f2cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c06ca859-bd37-4160-8452-e7b623e0f149 tempest-CinderUnicodeTest-99327618 None] Created volume successfully. Nov 03 17:12:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Creating offline snapshot ce3255e7-c396-4c5b-813e-13509f8a7809 of volume b89ea522-9bc3-41f1-9e63-a4d666383dde {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:12:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8f84f-c431-40a2-97ec-18aa5c02d067]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:47 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde Nov 03 17:12:47 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:47 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde" returned: 0 in 0.377s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:47 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 1G Nov 03 17:12:47 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:48 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 1G" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89ea522-9bc3-41f1-9e63-a4d666383dde -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:48 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89ea522-9bc3-41f1-9e63-a4d666383dde -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 Nov 03 17:12:48 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:48 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89ea522-9bc3-41f1-9e63-a4d666383dde -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809" returned: 0 in 0.299s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:48 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 is being set with open permissions: ugo+rw Nov 03 17:12:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:48 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 Nov 03 17:12:48 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:48 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809" returned: 0 in 0.251s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:48 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.info Nov 03 17:12:48 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:49 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.info" returned: 0 in 0.270s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:49 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.info is being set with open permissions: ugo+rw Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:49 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.info Nov 03 17:12:49 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:49 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.info" returned: 0 in 0.248s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6f6bfd2b-07e1-4180-8609-0fc17b9ddbf9 tempest-CinderUnicodeTest-99327618 None] Create snapshot completed successfully Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "cinder-ce3255e7-c396-4c5b-813e-13509f8a7809-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-ce3255e7-c396-4c5b-813e-13509f8a7809-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "cinder-quobyte-b89ea522-9bc3-41f1-9e63-a4d666383dde" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-quobyte-b89ea522-9bc3-41f1-9e63-a4d666383dde" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "cinder-quobyte-ce3255e7-c396-4c5b-813e-13509f8a7809" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-quobyte-ce3255e7-c396-4c5b-813e-13509f8a7809" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Deleting offline snapshot ce3255e7-c396-4c5b-813e-13509f8a7809 of volume b89ea522-9bc3-41f1-9e63-a4d666383dde {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] snapshot_file for this snap is: volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab0518f-c048-4b30-a1f6-43c56b3dd4f2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:49 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 Nov 03 17:12:49 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:49 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809" returned: 0 in 0.362s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b89ea522-9bc3-41f1-9e63-a4d666383dde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0a343b-7852-473a-a4c9-65a1eb77dbff]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:50 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde Nov 03 17:12:50 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:50 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:50 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 Nov 03 17:12:50 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:50 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809" returned: 0 in 0.317s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:50 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809 Nov 03 17:12:50 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:50 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde.ce3255e7-c396-4c5b-813e-13509f8a7809" returned: 0 in 0.242s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-quobyte-ce3255e7-c396-4c5b-813e-13509f8a7809" released by "_delete_snapshot" :: held 1.376s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-quobyte-b89ea522-9bc3-41f1-9e63-a4d666383dde" released by "delete_snapshot" :: held 1.401s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:51 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Created reservations ['e80b78b3-8046-4efa-8380-6d42c7d02ad7', '0d1bd1f4-6f0d-46ca-a856-7305f8341b57', '3358be4a-d000-4e29-9a6d-c21ffbe68a05', 'dfee9429-4901-45dd-87fb-b2ef5e34fd95'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:51 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Delete snapshot completed successfully. Nov 03 17:12:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-0e12f303-ce4c-4578-a593-48e0d244d495 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-ce3255e7-c396-4c5b-813e-13509f8a7809-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "cinder-b89ea522-9bc3-41f1-9e63-a4d666383dde-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-b89ea522-9bc3-41f1-9e63-a4d666383dde-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "cinder-quobyte-b89ea522-9bc3-41f1-9e63-a4d666383dde" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-quobyte-b89ea522-9bc3-41f1-9e63-a4d666383dde" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:51 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf859ae3-47df-42be-a733-1400369e8918]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:51 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde Nov 03 17:12:51 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:52 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde" returned: 0 in 0.357s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:52 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde Nov 03 17:12:52 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:52 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b89ea522-9bc3-41f1-9e63-a4d666383dde" returned: 0 in 0.268s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-quobyte-b89ea522-9bc3-41f1-9e63-a4d666383dde" released by "delete_volume" :: held 0.685s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Created reservations ['eed66781-78c5-49ee-9990-edf53d55fb45', '6940d265-d9a0-4ebc-84f1-efada68955df', 'b4d2d29b-8351-4d5d-8128-9827f69b4fc9', '39dd4aad-d0cf-4e01-831e-4ca8c8717553'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:52 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:52 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:52 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.250s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:52 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Deleted volume successfully. Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ace7dfd6-f278-4622-aafa-d2b817ae8fa5 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-b89ea522-9bc3-41f1-9e63-a4d666383dde-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "cinder-53ab90ea-2c4e-457e-813e-4d4b959d3757-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-53ab90ea-2c4e-457e-813e-4d4b959d3757-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "cinder-quobyte-53ab90ea-2c4e-457e-813e-4d4b959d3757" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-quobyte-53ab90ea-2c4e-457e-813e-4d4b959d3757" acquired by "delete_volume" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e8f243-e3ae-443b-bc94-629e1440fa46]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:53 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 Nov 03 17:12:53 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:53 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757" returned: 0 in 0.355s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:53 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757 Nov 03 17:12:53 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:53 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-53ab90ea-2c4e-457e-813e-4d4b959d3757" returned: 0 in 0.254s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-quobyte-53ab90ea-2c4e-457e-813e-4d4b959d3757" released by "delete_volume" :: held 0.648s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Created reservations ['dab0c696-ad1a-4615-8efa-757fd7c566a5', '2b52ce1c-cbbe-4107-a9b4-094597de3b37', 'd3826ed1-898d-4fa8-b23d-7cce77ebf9e8', '58139554-41cb-4a83-a840-d9f566b7a429'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:53 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:12:53 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:54 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.259s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:54 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Deleted volume successfully. Nov 03 17:12:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1b1283a5-5d8a-419d-a7b4-469a601f2913 tempest-CinderUnicodeTest-99327618 None] Lock "cinder-53ab90ea-2c4e-457e-813e-4d4b959d3757-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:03 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:INSERT=30,cinder:SELECT=102,cinder:UPDATE=119,cinder:DELETE=11 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:13:04 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:INSERT=23,cinder:UPDATE=87,cinder:DELETE=6,cinder:SELECT=54 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (a1688b5e-bac1-4820-9f7c-0217a7d413a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5436417-fb8a-472d-b0a8-be2610d3230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5436417-fb8a-472d-b0a8-be2610d3230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1290462872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84388f3a-ff48-4b3f-9caa-611759ec5b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:07Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5844d464-89fa-4910-ac05-fbd262b96d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5844d464-89fa-4910-ac05-fbd262b96d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8615d9b0-014a-46a2-9008-382010013958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8615d9b0-014a-46a2-9008-382010013958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84388f3a-ff48-4b3f-9caa-611759ec5b4d', 'volume_name': 'volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724283ae-c5cb-4e47-8180-981960a1d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724283ae-c5cb-4e47-8180-981960a1d972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d310359-387e-40cd-b85b-03b7ca1bf1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Volume 84388f3a-ff48-4b3f-9caa-611759ec5b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d', 'volume_size': 1} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1290462872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84388f3a-ff48-4b3f-9caa-611759ec5b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:07Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Creating volume 84388f3a-ff48-4b3f-9caa-611759ec5b4d {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:06 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:06 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d 1073741824 Nov 03 17:13:06 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (d281904a-518e-493f-a2c5-b0ea38e7f500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da1bfad-6f8b-4aed-9b11-9b3f3adc3702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da1bfad-6f8b-4aed-9b11-9b3f3adc3702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560621519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da137ed7-fdcf-425f-8cfe-bf9fbef1eea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:07Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e7dc0b-6848-42e4-bf05-94c3a04b00c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e7dc0b-6848-42e4-bf05-94c3a04b00c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a8c00d-0fb0-45b3-b58a-176c06ef2467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a8c00d-0fb0-45b3-b58a-176c06ef2467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da137ed7-fdcf-425f-8cfe-bf9fbef1eea7', 'volume_name': 'volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a70a379-7729-4fde-9a3d-afdf58c731dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a70a379-7729-4fde-9a3d-afdf58c731dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b330f5-244c-4090-9d5e-0f0399a17345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:06 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume da137ed7-fdcf-425f-8cfe-bf9fbef1eea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7', 'volume_size': 1} Nov 03 17:13:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (e6594760-6c79-4229-8855-c346e62aac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75791a9-b6ed-402b-a365-1a95d4ec87d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75791a9-b6ed-402b-a365-1a95d4ec87d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-327090693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838b78f0-545d-4442-b84e-42ba698df1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:07Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3990010b-97ac-478d-ac2e-9e91fe57ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3990010b-97ac-478d-ac2e-9e91fe57ee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db77cba0-038d-454c-8036-e9b801fe3c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db77cba0-038d-454c-8036-e9b801fe3c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838b78f0-545d-4442-b84e-42ba698df1a6', 'volume_name': 'volume-838b78f0-545d-4442-b84e-42ba698df1a6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a501c4-7f66-4a3e-912d-4ddfc590aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a501c4-7f66-4a3e-912d-4ddfc590aca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6530e68-f13b-45f5-bad4-7700f158b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Volume 838b78f0-545d-4442-b84e-42ba698df1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838b78f0-545d-4442-b84e-42ba698df1a6', 'volume_size': 1} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:07 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (60a2a10d-607a-4b07-91f4-2b27deed63c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a650c04-fc96-4d87-aed8-fa62054f9395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d 1073741824" returned: 0 in 0.836s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a650c04-fc96-4d87-aed8-fa62054f9395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1178838361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6d5702-8bee-4deb-a7ef-341feb6f6447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:08Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b221e17-d77b-49dd-8c46-4dc05f531f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b221e17-d77b-49dd-8c46-4dc05f531f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e784109-cbfd-47f7-9219-5ec25f7611ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e784109-cbfd-47f7-9219-5ec25f7611ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6d5702-8bee-4deb-a7ef-341feb6f6447', 'volume_name': 'volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb4738c-5f39-4131-bbbd-d829d53f92c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb4738c-5f39-4131-bbbd-d829d53f92c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f727a8d1-8fa8-4230-9fb7-adbeb668c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:07 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Volume 1e6d5702-8bee-4deb-a7ef-341feb6f6447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447', 'volume_size': 1} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:07 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d Nov 03 17:13:07 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:08 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d" returned: 0 in 0.343s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560621519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da137ed7-fdcf-425f-8cfe-bf9fbef1eea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:07Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Creating volume da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:08 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:08 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 1073741824 Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d310359-387e-40cd-b85b-03b7ca1bf1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074caaa6-46b4-4a79-b6e4-647474dfdd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Volume volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d (84388f3a-ff48-4b3f-9caa-611759ec5b4d): created successfully Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074caaa6-46b4-4a79-b6e4-647474dfdd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (a1688b5e-bac1-4820-9f7c-0217a7d413a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (a3c21290-9ead-4492-9562-4066b6e7564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f140af-aa8c-4ce8-9ae7-bcc1805255ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f140af-aa8c-4ce8-9ae7-bcc1805255ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1099346650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a8b9a1-d095-450d-ae91-699d2fd90394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:08Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4416f386-2608-437a-af2b-1dc4eacdbcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4416f386-2608-437a-af2b-1dc4eacdbcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3705d2b-ce60-433d-a0b2-f60a028ce222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3705d2b-ce60-433d-a0b2-f60a028ce222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a8b9a1-d095-450d-ae91-699d2fd90394', 'volume_name': 'volume-93a8b9a1-d095-450d-ae91-699d2fd90394', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260a2ead-b368-42ff-a0de-eb3c5a9c6eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260a2ead-b368-42ff-a0de-eb3c5a9c6eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5a2585-8cd1-4663-9e4f-9d6ff59e288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Volume 93a8b9a1-d095-450d-ae91-699d2fd90394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a8b9a1-d095-450d-ae91-699d2fd90394', 'volume_size': 1} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4b70c16e-51cc-4917-af17-032c0265a8cc tempest-CreateVolumesFromImageTest-489061054 None] Created volume successfully. Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (15d87326-20a1-4d23-a0ed-f8d9b0190334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c6fa91-bdba-4581-99b9-2686888d4dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c6fa91-bdba-4581-99b9-2686888d4dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-986406639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:09Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88305be-c5a2-446b-8799-0d1bad529022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88305be-c5a2-446b-8799-0d1bad529022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebece8e1-5596-4b76-ab15-3ea7b1208807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebece8e1-5596-4b76-ab15-3ea7b1208807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b', 'volume_name': 'volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb30eb5a-e8c4-4133-b456-a0fb46edf9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb30eb5a-e8c4-4133-b456-a0fb46edf9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551ea116-d30c-4a43-82f0-9d610bba4079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:08 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Volume 14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b', 'volume_size': 1} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 1073741824" returned: 0 in 0.791s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:09 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 Nov 03 17:13:09 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:09 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" returned: 0 in 0.300s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-327090693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838b78f0-545d-4442-b84e-42ba698df1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:07Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Creating volume 838b78f0-545d-4442-b84e-42ba698df1a6 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:09 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b330f5-244c-4090-9d5e-0f0399a17345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:09 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 1073741824 Nov 03 17:13:09 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010b631e-ad08-4b81-b54f-5eb7ef811f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:09 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 (da137ed7-fdcf-425f-8cfe-bf9fbef1eea7): created successfully Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010b631e-ad08-4b81-b54f-5eb7ef811f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:09 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (d281904a-518e-493f-a2c5-b0ea38e7f500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:09 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c13c4a83-77ed-431a-b26e-c842e99352a0 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created volume successfully. Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:10 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 1073741824" returned: 0 in 0.752s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:10 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 Nov 03 17:13:10 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:10 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6" returned: 0 in 0.291s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.667s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1178838361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6d5702-8bee-4deb-a7ef-341feb6f6447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:08Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Creating volume 1e6d5702-8bee-4deb-a7ef-341feb6f6447 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:10 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6530e68-f13b-45f5-bad4-7700f158b511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838b78f0-545d-4442-b84e-42ba698df1a6', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 1073741824 Nov 03 17:13:10 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98837bfb-e62d-41c9-84cf-074dd6709318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Volume volume-838b78f0-545d-4442-b84e-42ba698df1a6 (838b78f0-545d-4442-b84e-42ba698df1a6): created successfully Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98837bfb-e62d-41c9-84cf-074dd6709318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (e6594760-6c79-4229-8855-c346e62aac43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:10 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-59a14749-5d23-42ba-a5c3-9c549d15d80c tempest-CreateVolumesFromImageTest-489061054 None] Created volume successfully. Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Flow 'volume_create_manager' (dabbbf75-a1f8-444b-bafa-111e3161cd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96c67a4-cc17-4bfe-89f9-47b1498a1060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96c67a4-cc17-4bfe-89f9-47b1498a1060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2702bb0-1642-4e82-8586-1d171609391b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aec90c0087143c6ba5ff4f86bc9d05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:11Z,use_quota=True,user_id='e8b6e1666fa64c4ab0b44b7f1f225b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33654ad5-1ad6-4eee-b405-560319919ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33654ad5-1ad6-4eee-b405-560319919ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cbf33a-7cdb-46c7-b9e2-6fa51423c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cbf33a-7cdb-46c7-b9e2-6fa51423c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2702bb0-1642-4e82-8586-1d171609391b', 'volume_name': 'volume-d2702bb0-1642-4e82-8586-1d171609391b', 'volume_size': 1, 'image_id': 'bd57624a-9f9e-4837-9063-eb834f21e5f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd57624a-9f9e-4837-9063-eb834f21e5f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70ae545966687e61395daacfb678e51f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aec90c0087143c6ba5ff4f86bc9d05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e16efdad7b81a1cf72f371eb10e7d4427b3ccf8523c427a39e8918593cb93034ebbae1f8f665f8d907e3b0c508874f43fbc1c2b567209614d2afd31d20ded8b8', 'id': 'bd57624a-9f9e-4837-9063-eb834f21e5f3', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd57624a-9f9e-4837-9063-eb834f21e5f3/file', 'properties': {}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9a1b77-d13d-4127-82a4-a764b5e1341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9a1b77-d13d-4127-82a4-a764b5e1341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37479f6-6dfa-4ce7-a8ec-d44776dd6643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Volume d2702bb0-1642-4e82-8586-1d171609391b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2702bb0-1642-4e82-8586-1d171609391b', 'volume_size': 1, 'image_id': 'bd57624a-9f9e-4837-9063-eb834f21e5f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd57624a-9f9e-4837-9063-eb834f21e5f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70ae545966687e61395daacfb678e51f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aec90c0087143c6ba5ff4f86bc9d05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e16efdad7b81a1cf72f371eb10e7d4427b3ccf8523c427a39e8918593cb93034ebbae1f8f665f8d907e3b0c508874f43fbc1c2b567209614d2afd31d20ded8b8', 'id': 'bd57624a-9f9e-4837-9063-eb834f21e5f3', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd57624a-9f9e-4837-9063-eb834f21e5f3/file', 'properties': {}}, 'image_service': } Nov 03 17:13:10 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Trying to clone d2702bb0-1642-4e82-8586-1d171609391b from image bd57624a-9f9e-4837-9063-eb834f21e5f3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bd57624a-9f9e-4837-9063-eb834f21e5f3', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:13:11 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 1073741824" returned: 0 in 0.619s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:13:11 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:11 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 Nov 03 17:13:11 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95e804d-16e1-4f15-9ffc-cd826bafb2b6]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:11 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD Nov 03 17:13:11 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:11 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.970s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1099346650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a8b9a1-d095-450d-ae91-699d2fd90394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:08Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Creating volume 93a8b9a1-d095-450d-ae91-699d2fd90394 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:11 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:11 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 1073741824 Nov 03 17:13:11 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f727a8d1-8fa8-4230-9fb7-adbeb668c103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3c8f3e-593f-49c8-a9c0-52be95472df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Volume volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 (1e6d5702-8bee-4deb-a7ef-341feb6f6447): created successfully Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3c8f3e-593f-49c8-a9c0-52be95472df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (60a2a10d-607a-4b07-91f4-2b27deed63c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b9be69f2-443f-4cc3-b1e0-9e4b67c5cfcc tempest-CreateVolumesFromImageTest-489061054 None] Created volume successfully. Nov 03 17:13:11 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Flow 'volume_create_manager' (6958d947-effc-406c-b451-d4713db5286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23a05ef-923e-4f8e-b796-3fdbb4f77883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23a05ef-923e-4f8e-b796-3fdbb4f77883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71670e2-a4ab-46e7-ac94-1603d984a5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9771f679da8476db8835c9ae50c59ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:12Z,use_quota=True,user_id='d491ad9183ec44a1aec187a276141550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fab00a62-12dc-4e2c-8036-3c791010beda),volume_type_id=fab00a62-12dc-4e2c-8036-3c791010beda)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231e7b24-2b6a-4e67-975d-ef36e5d8ed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231e7b24-2b6a-4e67-975d-ef36e5d8ed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec4c536-69e9-46ba-86ec-33e91be434ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.image.glance [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Creating Keystone auth plugin from conf {{(pid=86939) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:13:11 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD Nov 03 17:13:11 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:11 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:11 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Temporary image bd57624a-9f9e-4837-9063-eb834f21e5f3 is fetched for user e8b6e1666fa64c4ab0b44b7f1f225b0e. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec4c536-69e9-46ba-86ec-33e91be434ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c71670e2-a4ab-46e7-ac94-1603d984a5da', 'volume_name': 'volume-c71670e2-a4ab-46e7-ac94-1603d984a5da', 'volume_size': 1, 'image_id': '8a43c293-55c9-4510-8742-7592ea0f0227', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a43c293-55c9-4510-8742-7592ea0f0227', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e21db49d13834562370e6646363ef0b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9771f679da8476db8835c9ae50c59ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc81f54ecf731f6f96d49dfed73711be897eb26aaeebc31bf7cb812ade586d1f6903c4b4017969c2e91809104d443bfcd05d465079790d253a65f3c040163013', 'id': '8a43c293-55c9-4510-8742-7592ea0f0227', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a43c293-55c9-4510-8742-7592ea0f0227/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0104c579-a185-4a0d-942f-719a9b615d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0104c579-a185-4a0d-942f-719a9b615d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9bebac-1cda-4fcc-824d-d52f06e0ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:12 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Volume c71670e2-a4ab-46e7-ac94-1603d984a5da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c71670e2-a4ab-46e7-ac94-1603d984a5da', 'volume_size': 1, 'image_id': '8a43c293-55c9-4510-8742-7592ea0f0227', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a43c293-55c9-4510-8742-7592ea0f0227', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e21db49d13834562370e6646363ef0b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9771f679da8476db8835c9ae50c59ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc81f54ecf731f6f96d49dfed73711be897eb26aaeebc31bf7cb812ade586d1f6903c4b4017969c2e91809104d443bfcd05d465079790d253a65f3c040163013', 'id': '8a43c293-55c9-4510-8742-7592ea0f0227', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a43c293-55c9-4510-8742-7592ea0f0227/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Trying to clone c71670e2-a4ab-46e7-ac94-1603d984a5da from image 8a43c293-55c9-4510-8742-7592ea0f0227 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a43c293-55c9-4510-8742-7592ea0f0227', 'metadata': {}}]). {{(pid=86939) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:13:12 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 1073741824" returned: 0 in 0.590s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9526af1a-641d-41c9-9eed-800819aadcae]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:13:12 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:13:12 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 Nov 03 17:13:12 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d94858b-df2a-4da9-8e00-16d4f93f218b]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:12 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD Nov 03 17:13:12 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:12 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD Nov 03 17:13:12 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:12 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394" returned: 0 in 0.307s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-986406639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e72d785c4cd42a3bb494872bc08db55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:09Z,use_quota=True,user_id='dd09ece2b6db498fb14c2c74d2ef7757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Creating volume 14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:12 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5a2585-8cd1-4663-9e4f-9d6ff59e288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a8b9a1-d095-450d-ae91-699d2fd90394', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b 1073741824 Nov 03 17:13:12 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b220a479-09d0-4cf5-b2e4-3cb5addcc1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:12 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:12 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Volume volume-93a8b9a1-d095-450d-ae91-699d2fd90394 (93a8b9a1-d095-450d-ae91-699d2fd90394): created successfully Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b220a479-09d0-4cf5-b2e4-3cb5addcc1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (a3c21290-9ead-4492-9562-4066b6e7564a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:12 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-58bb3ff4-92e4-43fa-9913-645e463798bb tempest-CreateVolumesFromImageTest-489061054 None] Created volume successfully. Nov 03 17:13:12 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:12 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD Nov 03 17:13:12 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:12 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD Nov 03 17:13:12 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:13 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:13 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD" returned: 1 in 0.439s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Temporary image 8a43c293-55c9-4510-8742-7592ea0f0227 is fetched for user d491ad9183ec44a1aec187a276141550. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:13:13 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b 1073741824" returned: 0 in 0.613s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2df34b-9e11-4cc0-8f2a-8ad46969efd6]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:13 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b Nov 03 17:13:13 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:13 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD Nov 03 17:13:13 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:13 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b" returned: 0 in 0.289s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.416s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Creating offline snapshot 4d4e9831-9a9f-452e-83c7-96eff3ee1a31 of volume da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551ea116-d30c-4a43-82f0-9d610bba4079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ff51d5-78fb-4748-b226-b6539d9b5909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e373f89-5a30-409e-a5c3-2e20205e4912]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:13 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:13 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Volume volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b (14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b): created successfully Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ff51d5-78fb-4748-b226-b6539d9b5909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Flow 'volume_create_manager' (15d87326-20a1-4d23-a0ed-f8d9b0190334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5ca21c52-25d7-4c17-9ef8-28fc197079c1 tempest-CreateVolumesFromImageTest-489061054 None] Created volume successfully. Nov 03 17:13:13 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 Nov 03 17:13:13 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:13 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD Nov 03 17:13:13 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:13 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" returned: 0 in 0.412s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:13 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:13 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 1G Nov 03 17:13:13 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:14 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 1G" returned: 0 in 0.415s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:14 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 Nov 03 17:13:14 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-quobyte-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:14 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31" returned: 0 in 0.412s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:14 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 is being set with open permissions: ugo+rw Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:14 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 Nov 03 17:13:14 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb58af76-0cce-41d0-970a-14c242090951]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:14 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b Nov 03 17:13:14 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:15 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31" returned: 0 in 0.270s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:15 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.info Nov 03 17:13:15 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:15 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b" returned: 0 in 0.432s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:15 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b Nov 03 17:13:15 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:15 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.info" returned: 0 in 0.288s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:15 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.info is being set with open permissions: ugo+rw Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:15 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.info Nov 03 17:13:15 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:15 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b" returned: 0 in 0.260s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b" released by "delete_volume" :: held 0.754s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Created reservations ['2f716e6a-5d09-4769-aa4e-08befc934a5c', 'bbcd4c19-5743-4cb8-b6cd-c51f0e88df7b', '66c918bb-2d6e-4e07-bd03-f438cd70ee28', '4f40a2a8-d349-4ed2-8d7c-a90b701ba1a2'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:15 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.info" returned: 0 in 0.276s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.630s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2702bb0-1642-4e82-8586-1d171609391b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aec90c0087143c6ba5ff4f86bc9d05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:11Z,use_quota=True,user_id='e8b6e1666fa64c4ab0b44b7f1f225b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Creating volume d2702bb0-1642-4e82-8586-1d171609391b {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:15 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:15 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b 1073741824 Nov 03 17:13:15 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:15 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:15 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:15 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8f2a533b-6cc5-4ba6-bc67-59614d593eba tempest-CreateVolumesFromSnapshotTest-1128253418 None] Create snapshot completed successfully Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-93a8b9a1-d095-450d-ae91-699d2fd90394-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-93a8b9a1-d095-450d-ae91-699d2fd90394-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-quobyte-93a8b9a1-d095-450d-ae91-699d2fd90394" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-93a8b9a1-d095-450d-ae91-699d2fd90394" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dae3ae3-e576-45e6-b2ac-bf48eb65d9ba]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:16 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Deleted volume successfully. Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f44ae266-7d3e-4407-a20c-5d7d1972d684 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-14f4a9ae-0f7d-4316-9cc9-d3ff88e1462b-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:16 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 Nov 03 17:13:16 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:16 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b 1073741824" returned: 0 in 0.516s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:16 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b Nov 03 17:13:16 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:16 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:16 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394 Nov 03 17:13:16 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:16 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b" returned: 0 in 0.271s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.543s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71670e2-a4ab-46e7-ac94-1603d984a5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9771f679da8476db8835c9ae50c59ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:12Z,use_quota=True,user_id='d491ad9183ec44a1aec187a276141550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fab00a62-12dc-4e2c-8036-3c791010beda),volume_type_id=fab00a62-12dc-4e2c-8036-3c791010beda)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Creating volume c71670e2-a4ab-46e7-ac94-1603d984a5da {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:16 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:16 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da 1073741824 Nov 03 17:13:16 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Attempting download of bd57624a-9f9e-4837-9063-eb834f21e5f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd57624a-9f9e-4837-9063-eb834f21e5f3', 'metadata': {}}])) to volume d2702bb0-1642-4e82-8586-1d171609391b. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f520147-c9c7-4ea0-a941-aee0820ab8c5]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd57624a-9f9e-4837-9063-eb834f21e5f3_abf5_yyo {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:16 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:16 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd57624a-9f9e-4837-9063-eb834f21e5f3_abf5_yyo Nov 03 17:13:16 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-93a8b9a1-d095-450d-ae91-699d2fd90394" returned: 0 in 0.347s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-93a8b9a1-d095-450d-ae91-699d2fd90394" released by "delete_volume" :: held 0.830s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Created reservations ['a0ec7ea9-78f2-4fbd-9cfe-62955b17b63b', 'd5cee5bd-2063-46a3-829f-8bb90c337d46', 'e6095dcc-822f-4415-b691-2232d60ede2e', 'a5aebeba-ffe5-4894-98fb-4b9839c12585'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:16 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (ebb83402-508f-4d5b-82eb-d0fa9bf593b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ec4213-05e2-4418-b244-c5d9874b1a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ec4213-05e2-4418-b244-c5d9874b1a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2120967759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf1354d-7ebd-4e14-aed0-bc145665d3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:17Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7601ae-e9c2-46b3-b545-7ec18d352305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7601ae-e9c2-46b3-b545-7ec18d352305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3b31bd-3dd4-43ac-b333-e9ae6bffe3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3b31bd-3dd4-43ac-b333-e9ae6bffe3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf1354d-7ebd-4e14-aed0-bc145665d3c1', 'volume_name': 'volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b47fd6-dffc-4626-abb9-55e61e222a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b47fd6-dffc-4626-abb9-55e61e222a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5e3aef-da87-4c47-827e-a6c8c761322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume ebf1354d-7ebd-4e14-aed0-bc145665d3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1', 'volume_size': 1} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:17 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd57624a-9f9e-4837-9063-eb834f21e5f3_abf5_yyo" returned: 0 in 0.513s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd57624a-9f9e-4837-9063-eb834f21e5f3_abf5_yyo {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-1e6d5702-8bee-4deb-a7ef-341feb6f6447-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:17 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da 1073741824" returned: 0 in 0.746s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-1e6d5702-8bee-4deb-a7ef-341feb6f6447-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:17 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:17 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:17 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd57624a-9f9e-4837-9063-eb834f21e5f3_abf5_yyo Nov 03 17:13:17 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-quobyte-1e6d5702-8bee-4deb-a7ef-341feb6f6447" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-1e6d5702-8bee-4deb-a7ef-341feb6f6447" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:17 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da Nov 03 17:13:17 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89e7fa7-6dd5-4a88-94a4-d9e358434bb2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:17 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd57624a-9f9e-4837-9063-eb834f21e5f3_abf5_yyo" returned: 1 in 0.461s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd57624a-9f9e-4837-9063-eb834f21e5f3_abf5_yyo' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a461012a-6680-4f85-b690-34c90112e12c]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:17 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 Nov 03 17:13:17 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (3d247085-a618-404c-84de-ab2a767cfd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8411e0b8-66ee-4a2f-bdc9-9616fe671e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8411e0b8-66ee-4a2f-bdc9-9616fe671e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457366366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc4d01d-fe07-4b30-a627-253b98b58ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:18Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20d8ab2-9788-4b5b-80bc-05cf74b09a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20d8ab2-9788-4b5b-80bc-05cf74b09a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b21d00-8ac5-4173-aee2-0e51734a3639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b21d00-8ac5-4173-aee2-0e51734a3639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc4d01d-fe07-4b30-a627-253b98b58ad8', 'volume_name': 'volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff7eaba-1296-4993-b394-861c63354295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff7eaba-1296-4993-b394-861c63354295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD Nov 03 17:13:17 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f236784-ad88-4127-9330-25a6f10b6edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume 1bc4d01d-fe07-4b30-a627-253b98b58ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8', 'volume_size': 1} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da" returned: 0 in 0.452s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.553s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2120967759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf1354d-7ebd-4e14-aed0-bc145665d3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:17Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Creating volume ebf1354d-7ebd-4e14-aed0-bc145665d3c1 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:17 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Deleted volume successfully. Nov 03 17:13:17 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 1073741824 Nov 03 17:13:17 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Attempting download of 8a43c293-55c9-4510-8742-7592ea0f0227 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a43c293-55c9-4510-8742-7592ea0f0227', 'metadata': {}}])) to volume c71670e2-a4ab-46e7-ac94-1603d984a5da. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-7bf1fa05-d9a4-4d7b-9922-fa6c271adec5 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-93a8b9a1-d095-450d-ae91-699d2fd90394-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7558ed-9006-423d-a6a1-8b7be82022a6]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a43c293-55c9-4510-8742-7592ea0f0227_z8mb1__3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447" returned: 0 in 0.738s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:18 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a43c293-55c9-4510-8742-7592ea0f0227_z8mb1__3 Nov 03 17:13:18 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447 Nov 03 17:13:18 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:18 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD" returned: 0 in 0.643s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:18 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD Nov 03 17:13:18 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (e4bc036a-5e51-4508-80a4-b36000dbbc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20648c7c-b789-4b42-97ad-bd84515efde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:18 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:18 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20648c7c-b789-4b42-97ad-bd84515efde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-913440677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba5589b-2ab4-4d11-8476-474d31865ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:18Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:18 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25479ea-cbef-4a61-8b31-7f970138be13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25479ea-cbef-4a61-8b31-7f970138be13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eab6776-982f-4c7a-9765-2cd785b2b9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eab6776-982f-4c7a-9765-2cd785b2b9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba5589b-2ab4-4d11-8476-474d31865ce2', 'volume_name': 'volume-cba5589b-2ab4-4d11-8476-474d31865ce2', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6475c90c-dd24-45b2-b5d2-b9936576a8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6475c90c-dd24-45b2-b5d2-b9936576a8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8185ea-4217-4feb-ae13-c726cead8dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:18 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume cba5589b-2ab4-4d11-8476-474d31865ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba5589b-2ab4-4d11-8476-474d31865ce2', 'volume_size': 1} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a43c293-55c9-4510-8742-7592ea0f0227_z8mb1__3" returned: 0 in 0.685s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 1073741824" returned: 0 in 0.821s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1e6d5702-8bee-4deb-a7ef-341feb6f6447" returned: 0 in 0.446s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a43c293-55c9-4510-8742-7592ea0f0227_z8mb1__3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-1e6d5702-8bee-4deb-a7ef-341feb6f6447" released by "delete_volume" :: held 1.294s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 Nov 03 17:13:18 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Created reservations ['5fe72602-cbbd-4f4e-97b1-8083dacd03c0', '0204626f-2060-494f-a7d8-13378974d8d1', '8706f375-eaf2-4eaf-85dd-8261ff7e2063', '7c51ee7b-856a-45d0-a266-5dc855c9212e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:18 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:18 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a43c293-55c9-4510-8742-7592ea0f0227_z8mb1__3 Nov 03 17:13:18 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD" returned: 1 in 0.541s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] bd57624a-9f9e-4837-9063-eb834f21e5f3 was raw, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b Nov 03 17:13:18 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:18 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:19 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1" returned: 0 in 0.502s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457366366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc4d01d-fe07-4b30-a627-253b98b58ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:18Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Creating volume 1bc4d01d-fe07-4b30-a627-253b98b58ad8 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:19 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:19 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 1073741824 Nov 03 17:13:19 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:19 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (96177236-6521-41e4-bc22-3156f671ee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb470e87-6671-489c-8970-9c22de985b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5e3aef-da87-4c47-827e-a6c8c761322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a18ab7-0313-4bbf-b401-6eb95bc082f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.431s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:19 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Deleted volume successfully. Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a43c293-55c9-4510-8742-7592ea0f0227_z8mb1__3" returned: 1 in 0.750s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a43c293-55c9-4510-8742-7592ea0f0227_z8mb1__3' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb470e87-6671-489c-8970-9c22de985b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657577144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3505ba-078e-44dd-bb7c-856ff6df0912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:19Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2e4791-720e-4ba0-9d72-d2989106ea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2e4791-720e-4ba0-9d72-d2989106ea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ca1bf6-4796-44f9-b105-5dd095ba52fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ca1bf6-4796-44f9-b105-5dd095ba52fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3505ba-078e-44dd-bb7c-856ff6df0912', 'volume_name': 'volume-6b3505ba-078e-44dd-bb7c-856ff6df0912', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500bde79-3e71-40f9-b11e-c6cc4f9be061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500bde79-3e71-40f9-b11e-c6cc4f9be061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53db87d7-6ff9-4d0e-865b-b1b3cd90a394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume 6b3505ba-078e-44dd-bb7c-856ff6df0912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3505ba-078e-44dd-bb7c-856ff6df0912', 'volume_size': 1} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5089b78-722f-478c-a823-1d10e8341330]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 (ebf1354d-7ebd-4e14-aed0-bc145665d3c1): created successfully Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a18ab7-0313-4bbf-b401-6eb95bc082f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (ebb83402-508f-4d5b-82eb-d0fa9bf593b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bfbeb0f8-6ea3-4a67-ac3d-111d6a0a23e1 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-1e6d5702-8bee-4deb-a7ef-341feb6f6447-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-51229972-7d69-41f1-a2fc-c5b517aa1eee tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created volume successfully. Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-838b78f0-545d-4442-b84e-42ba698df1a6-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:19 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD Nov 03 17:13:19 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-838b78f0-545d-4442-b84e-42ba698df1a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:19 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b" returned: 0 in 0.908s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bd57624a-9f9e-4837-9063-eb834f21e5f3_uxi_iksydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:13:19 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-quobyte-838b78f0-545d-4442-b84e-42ba698df1a6" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-838b78f0-545d-4442-b84e-42ba698df1a6" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:19 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b 1G Nov 03 17:13:19 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[88045998-60d6-49ef-9a5c-96736a042dc8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:19 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 1073741824" returned: 0 in 0.691s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (204bc643-7ca0-493d-b8aa-084603643c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3446509-7a1b-483a-aaa6-42dc90bd052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:19 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 Nov 03 17:13:19 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3446509-7a1b-483a-aaa6-42dc90bd052d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1042874010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628bab5c-2de3-4e3b-b59d-cae41a89165c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:20Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee772b7a-ce17-4aee-9589-29032d5d7fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee772b7a-ce17-4aee-9589-29032d5d7fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7112ae8-f33c-4569-8da8-2984256fe0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7112ae8-f33c-4569-8da8-2984256fe0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '628bab5c-2de3-4e3b-b59d-cae41a89165c', 'volume_name': 'volume-628bab5c-2de3-4e3b-b59d-cae41a89165c', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e9b678-a8a8-42f8-a106-4a63d356edb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e9b678-a8a8-42f8-a106-4a63d356edb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:20 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26de9c6a-e665-48e0-be0d-24352cea8d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:20 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume 628bab5c-2de3-4e3b-b59d-cae41a89165c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-628bab5c-2de3-4e3b-b59d-cae41a89165c', 'volume_size': 1} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD" returned: 0 in 0.615s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 Nov 03 17:13:20 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b 1G" returned: 0 in 0.436s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Downloaded image bd57624a-9f9e-4837-9063-eb834f21e5f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd57624a-9f9e-4837-9063-eb834f21e5f3', 'metadata': {}}])) to volume d2702bb0-1642-4e82-8586-1d171609391b successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Temporary image bd57624a-9f9e-4837-9063-eb834f21e5f3 for user e8b6e1666fa64c4ab0b44b7f1f225b0e is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Marking volume d2702bb0-1642-4e82-8586-1d171609391b as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Copying metadata from image bd57624a-9f9e-4837-9063-eb834f21e5f3 to d2702bb0-1642-4e82-8586-1d171609391b. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Creating volume glance metadata for volume d2702bb0-1642-4e82-8586-1d171609391b backed by image bd57624a-9f9e-4837-9063-eb834f21e5f3 with: {'image_id': 'bd57624a-9f9e-4837-9063-eb834f21e5f3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '70ae545966687e61395daacfb678e51f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:13:20 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD Nov 03 17:13:20 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37479f6-6dfa-4ce7-a8ec-d44776dd6643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2702bb0-1642-4e82-8586-1d171609391b', 'volume_size': 1, 'image_id': 'bd57624a-9f9e-4837-9063-eb834f21e5f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd57624a-9f9e-4837-9063-eb834f21e5f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70ae545966687e61395daacfb678e51f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aec90c0087143c6ba5ff4f86bc9d05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e16efdad7b81a1cf72f371eb10e7d4427b3ccf8523c427a39e8918593cb93034ebbae1f8f665f8d907e3b0c508874f43fbc1c2b567209614d2afd31d20ded8b8', 'id': 'bd57624a-9f9e-4837-9063-eb834f21e5f3', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd57624a-9f9e-4837-9063-eb834f21e5f3/file', 'properties': {}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ffd9e3b-90ba-40bb-be19-127af300dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:20 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Volume volume-d2702bb0-1642-4e82-8586-1d171609391b (d2702bb0-1642-4e82-8586-1d171609391b): created successfully Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ffd9e3b-90ba-40bb-be19-127af300dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Flow 'volume_create_manager' (dabbbf75-a1f8-444b-bafa-111e3161cd24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c6d78fcb-b8d0-43e6-86e7-69f28db7d2bb tempest-VolumeImageDependencyTests-714853493 None] Created volume successfully. Nov 03 17:13:20 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6" returned: 0 in 0.500s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6 Nov 03 17:13:20 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8" returned: 0 in 0.335s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.796s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-913440677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba5589b-2ab4-4d11-8476-474d31865ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:18Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Creating volume cba5589b-2ab4-4d11-8476-474d31865ce2 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:20 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 1073741824 Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f236784-ad88-4127-9330-25a6f10b6edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:20 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec76ade4-b5ac-459c-95fb-b061808077f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:20 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] 8a43c293-55c9-4510-8742-7592ea0f0227 was raw, converting to qcow2 {{(pid=86939) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 (1bc4d01d-fe07-4b30-a627-253b98b58ad8): created successfully Nov 03 17:13:20 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec76ade4-b5ac-459c-95fb-b061808077f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:20 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (3d247085-a618-404c-84de-ab2a767cfd15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9886bdd7-b06f-4da0-9928-38afae2f16ed tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created volume successfully. Nov 03 17:13:20 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-838b78f0-545d-4442-b84e-42ba698df1a6" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-838b78f0-545d-4442-b84e-42ba698df1a6" released by "delete_volume" :: held 0.835s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Created reservations ['42f7dadd-cab4-4091-8af6-4b09ae94e48e', 'e43e0214-317a-4b81-bf12-58465d09fada', 'e156bf20-3139-4137-86fc-be0a365eb754', 'd357f03a-5b78-46bc-afba-a47188f04c8f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:20 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-84388f3a-ff48-4b3f-9caa-611759ec5b4d-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-84388f3a-ff48-4b3f-9caa-611759ec5b4d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:20 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 1073741824" returned: 0 in 0.567s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "cinder-quobyte-84388f3a-ff48-4b3f-9caa-611759ec5b4d" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da" returned: 0 in 0.556s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a43c293-55c9-4510-8742-7592ea0f0227_h_3_r9yedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:13:21 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da 1G Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-84388f3a-ff48-4b3f-9caa-611759ec5b4d" acquired by "delete_volume" :: waited 0.039s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:21 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 Nov 03 17:13:21 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.345s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Deleted volume successfully. Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[270664b5-de0a-4ff9-b03e-669cb7639522]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1a1e4cac-f3f7-4926-8df4-dbce06d3b3c0 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-838b78f0-545d-4442-b84e-42ba698df1a6-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:21 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d Nov 03 17:13:21 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2" returned: 0 in 0.272s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.898s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657577144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3505ba-078e-44dd-bb7c-856ff6df0912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:19Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Creating volume 6b3505ba-078e-44dd-bb7c-856ff6df0912 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:21 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8185ea-4217-4feb-ae13-c726cead8dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba5589b-2ab4-4d11-8476-474d31865ce2', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f440ae-be2d-4232-88b5-f572e7884967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:21 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 1073741824 Nov 03 17:13:21 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da 1G" returned: 0 in 0.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Downloaded image 8a43c293-55c9-4510-8742-7592ea0f0227 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a43c293-55c9-4510-8742-7592ea0f0227', 'metadata': {}}])) to volume c71670e2-a4ab-46e7-ac94-1603d984a5da successfully. {{(pid=86939) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Temporary image 8a43c293-55c9-4510-8742-7592ea0f0227 for user d491ad9183ec44a1aec187a276141550 is deleted. {{(pid=86939) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.volume_utils [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Marking volume c71670e2-a4ab-46e7-ac94-1603d984a5da as bootable. {{(pid=86939) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:13:21 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume volume-cba5589b-2ab4-4d11-8476-474d31865ce2 (cba5589b-2ab4-4d11-8476-474d31865ce2): created successfully Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f440ae-be2d-4232-88b5-f572e7884967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (e4bc036a-5e51-4508-80a4-b36000dbbc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Copying metadata from image 8a43c293-55c9-4510-8742-7592ea0f0227 to c71670e2-a4ab-46e7-ac94-1603d984a5da. {{(pid=86939) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Creating volume glance metadata for volume c71670e2-a4ab-46e7-ac94-1603d984a5da backed by image 8a43c293-55c9-4510-8742-7592ea0f0227 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8a43c293-55c9-4510-8742-7592ea0f0227', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e21db49d13834562370e6646363ef0b5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86939) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:13:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ea8276e3-0f5c-46d4-ace4-49c42a230361 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created volume successfully. Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9bebac-1cda-4fcc-824d-d52f06e0ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71670e2-a4ab-46e7-ac94-1603d984a5da', 'volume_size': 1, 'image_id': '8a43c293-55c9-4510-8742-7592ea0f0227', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a43c293-55c9-4510-8742-7592ea0f0227', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e21db49d13834562370e6646363ef0b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9771f679da8476db8835c9ae50c59ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc81f54ecf731f6f96d49dfed73711be897eb26aaeebc31bf7cb812ade586d1f6903c4b4017969c2e91809104d443bfcd05d465079790d253a65f3c040163013', 'id': '8a43c293-55c9-4510-8742-7592ea0f0227', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a43c293-55c9-4510-8742-7592ea0f0227/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519dc54e-c774-4e78-a2bc-c52dbb36aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:21 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Volume volume-c71670e2-a4ab-46e7-ac94-1603d984a5da (c71670e2-a4ab-46e7-ac94-1603d984a5da): created successfully Nov 03 17:13:21 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519dc54e-c774-4e78-a2bc-c52dbb36aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Flow 'volume_create_manager' (6958d947-effc-406c-b451-d4713db5286d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d" returned: 0 in 0.465s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-8091bb29-df19-49a1-a6d6-4613bc909c3b tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Created volume successfully. Nov 03 17:13:21 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d Nov 03 17:13:21 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Acquiring lock "cinder-d2702bb0-1642-4e82-8586-1d171609391b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Lock "cinder-d2702bb0-1642-4e82-8586-1d171609391b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Acquiring lock "cinder-quobyte-d2702bb0-1642-4e82-8586-1d171609391b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Lock "cinder-quobyte-d2702bb0-1642-4e82-8586-1d171609391b" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae4019-c1b3-4e72-b103-817f87ea21e4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b Nov 03 17:13:21 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-84388f3a-ff48-4b3f-9caa-611759ec5b4d" returned: 0 in 0.344s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-quobyte-84388f3a-ff48-4b3f-9caa-611759ec5b4d" released by "delete_volume" :: held 0.885s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:21 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 1073741824" returned: 0 in 0.639s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Created reservations ['88440b93-10be-4692-9840-2a22bfebbf02', 'e558d61e-97e9-40ef-93ef-8cfc4abf35ee', '64d5a784-fa00-43b4-9952-3bca495d79bc', '7885d5a4-75eb-4bd9-8e29-f16ddee00718'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:22 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 Nov 03 17:13:22 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:22 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:22 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:22 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b" returned: 0 in 0.522s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:22 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b Nov 03 17:13:22 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:22 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912" returned: 0 in 0.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.371s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1042874010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628bab5c-2de3-4e3b-b59d-cae41a89165c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788a6b071d2f4c4e94f7532fcb68344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:20Z,use_quota=True,user_id='1e071ead73604d01a1bb39bd63efad3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Creating volume 628bab5c-2de3-4e3b-b59d-cae41a89165c {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:22 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53db87d7-6ff9-4d0e-865b-b1b3cd90a394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3505ba-078e-44dd-bb7c-856ff6df0912', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807db3df-f5a3-4d46-a717-c49e2431a3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:22 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c 1073741824 Nov 03 17:13:22 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:22 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 (6b3505ba-078e-44dd-bb7c-856ff6df0912): created successfully Nov 03 17:13:22 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807db3df-f5a3-4d46-a717-c49e2431a3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (96177236-6521-41e4-bc22-3156f671ee8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.368s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Deleted volume successfully. Nov 03 17:13:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cf049e7d-b68f-4d4c-a6e3-82e959fee0ce tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created volume successfully. Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-062f799e-cb27-4428-bc23-9a2fcd527c28 tempest-CreateVolumesFromImageTest-489061054 None] Lock "cinder-84388f3a-ff48-4b3f-9caa-611759ec5b4d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:22 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d2702bb0-1642-4e82-8586-1d171609391b" returned: 0 in 0.409s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Acquiring lock "cinder-c71670e2-a4ab-46e7-ac94-1603d984a5da-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Lock "cinder-quobyte-d2702bb0-1642-4e82-8586-1d171609391b" released by "delete_volume" :: held 0.996s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "cinder-c71670e2-a4ab-46e7-ac94-1603d984a5da-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Acquiring lock "cinder-quobyte-c71670e2-a4ab-46e7-ac94-1603d984a5da" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "cinder-quobyte-c71670e2-a4ab-46e7-ac94-1603d984a5da" acquired by "delete_volume" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Created reservations ['91501041-7e54-4ddd-b74e-faa22426a989', '6c2e8408-69c7-4bf1-aad5-6183c3a4d696', '27fcd807-3f55-4954-85d2-a1a94b8d1684', '2dc5b398-98d1-41a6-9904-697c3f24ec27'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dff8a1-6a38-4082-8cc3-5b554fa86220]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:23 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da Nov 03 17:13:23 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:23 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:23 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:23 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c 1073741824" returned: 0 in 0.657s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:23 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c Nov 03 17:13:23 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:23 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.388s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Deleted volume successfully. Nov 03 17:13:23 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1cdce28e-d50b-4289-abd0-f17d9bcbf42f tempest-VolumeImageDependencyTests-714853493 None] Lock "cinder-d2702bb0-1642-4e82-8586-1d171609391b-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da" returned: 0 in 0.554s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:23 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:23 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da Nov 03 17:13:23 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c" returned: 0 in 0.343s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26de9c6a-e665-48e0-be0d-24352cea8d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628bab5c-2de3-4e3b-b59d-cae41a89165c', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc720d3-2586-4d67-9063-992585180018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:23 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Volume volume-628bab5c-2de3-4e3b-b59d-cae41a89165c (628bab5c-2de3-4e3b-b59d-cae41a89165c): created successfully Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc720d3-2586-4d67-9063-992585180018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Flow 'volume_create_manager' (204bc643-7ca0-493d-b8aa-084603643c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a4d2182c-1fc1-4e66-8f24-58d158ef351c tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created volume successfully. Nov 03 17:13:23 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c71670e2-a4ab-46e7-ac94-1603d984a5da" returned: 0 in 0.274s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "cinder-quobyte-c71670e2-a4ab-46e7-ac94-1603d984a5da" released by "delete_volume" :: held 0.888s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Created reservations ['a0f5f5c8-9a3a-4269-b396-df3bcbf04b5a', '4e45a2d5-75d9-42f6-965f-d8880c08b1c7', '38ac1476-f199-4cd8-b37a-7d4aafe57f32', '6757da65-5479-4c15-966f-d4fb9e54ef70'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:23 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:23 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:24 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.313s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:24 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Deleted volume successfully. Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c2c5ffb0-fd44-4bfa-91b6-582f1e24da48 tempest-VolumeAndVolumeTypeFromImageTest-1338757716 None] Lock "cinder-c71670e2-a4ab-46e7-ac94-1603d984a5da-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-628bab5c-2de3-4e3b-b59d-cae41a89165c-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-628bab5c-2de3-4e3b-b59d-cae41a89165c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-quobyte-628bab5c-2de3-4e3b-b59d-cae41a89165c" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-628bab5c-2de3-4e3b-b59d-cae41a89165c" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f701c9be-4703-4816-a795-4b5cd4837638]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:24 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c Nov 03 17:13:24 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:25 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c" returned: 0 in 0.614s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:25 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c Nov 03 17:13:25 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:25 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-628bab5c-2de3-4e3b-b59d-cae41a89165c" returned: 0 in 0.303s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-628bab5c-2de3-4e3b-b59d-cae41a89165c" released by "delete_volume" :: held 1.004s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created reservations ['3f386b32-da0b-48f8-a10d-b3e20bbe9f6d', '37544ae3-d79f-49e4-9569-93f28a6fd537', 'c2e6e40a-fbb2-49e4-99f4-15dd01cf1bd2', 'ed221248-cb36-43ba-a892-a2b45bf291af'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:25 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:25 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:26 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:26 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Deleted volume successfully. Nov 03 17:13:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c010d851-316e-4213-b619-6b240125b8f5 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-628bab5c-2de3-4e3b-b59d-cae41a89165c-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-6b3505ba-078e-44dd-bb7c-856ff6df0912-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-6b3505ba-078e-44dd-bb7c-856ff6df0912-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-quobyte-6b3505ba-078e-44dd-bb7c-856ff6df0912" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-6b3505ba-078e-44dd-bb7c-856ff6df0912" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f798f4-2c7f-4986-9dc4-0fe4d400513c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:27 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 Nov 03 17:13:27 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (f91255e1-7748-4837-9b7f-c9e7e76b1dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacbb7c1-b93d-4a44-bf40-68f18f49ba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacbb7c1-b93d-4a44-bf40-68f18f49ba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830552166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b6872a-8411-4f56-805e-92663e348155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:27Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb3436-cc57-496b-90ed-d4709e8d1032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb3436-cc57-496b-90ed-d4709e8d1032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bd6128-38d0-4c77-a854-77dcbe09d00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bd6128-38d0-4c77-a854-77dcbe09d00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b6872a-8411-4f56-805e-92663e348155', 'volume_name': 'volume-12b6872a-8411-4f56-805e-92663e348155', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008af675-635d-4447-bee0-ac9975098480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008af675-635d-4447-bee0-ac9975098480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8d9410-c700-42a3-8769-77b56d1ae1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume 12b6872a-8411-4f56-805e-92663e348155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b6872a-8411-4f56-805e-92663e348155', 'volume_size': 1} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830552166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b6872a-8411-4f56-805e-92663e348155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:27Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Creating volume 12b6872a-8411-4f56-805e-92663e348155 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:27 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:27 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 1073741824 Nov 03 17:13:27 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:27 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912" returned: 0 in 0.568s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:27 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912 Nov 03 17:13:27 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:27 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-6b3505ba-078e-44dd-bb7c-856ff6df0912" returned: 0 in 0.335s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-6b3505ba-078e-44dd-bb7c-856ff6df0912" released by "delete_volume" :: held 0.974s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created reservations ['d8a22557-6e50-4a46-a41d-e37a711fc4ea', '06e98eae-6bfe-4709-bea2-1625b6ad1914', '5913a8bf-c52e-489e-9b7e-087f66758a36', 'cab0a1e1-745c-48f6-b916-bd73d33eaa4a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:28 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 1073741824" returned: 0 in 0.674s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:28 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:28 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:28 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 Nov 03 17:13:28 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:28 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.291s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Deleted volume successfully. Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-329422aa-1e2d-4d7a-aaab-1e7eef0ac8d9 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-6b3505ba-078e-44dd-bb7c-856ff6df0912-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:28 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155" returned: 0 in 0.320s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8d9410-c700-42a3-8769-77b56d1ae1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b6872a-8411-4f56-805e-92663e348155', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556b531b-bd0a-43a6-b7ef-6307afd81ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:28 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume volume-12b6872a-8411-4f56-805e-92663e348155 (12b6872a-8411-4f56-805e-92663e348155): created successfully Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556b531b-bd0a-43a6-b7ef-6307afd81ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:28 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (f91255e1-7748-4837-9b7f-c9e7e76b1dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-64fcdec8-1c0f-4976-9d77-1202ea62b12e tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created volume successfully. Nov 03 17:13:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-cba5589b-2ab4-4d11-8476-474d31865ce2-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-cba5589b-2ab4-4d11-8476-474d31865ce2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-quobyte-cba5589b-2ab4-4d11-8476-474d31865ce2" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-cba5589b-2ab4-4d11-8476-474d31865ce2" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:29 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e45ccdf-351f-46bf-b5a0-e69362ed4e6b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:29 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 Nov 03 17:13:29 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:29 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2" returned: 0 in 0.441s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:29 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2 Nov 03 17:13:29 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:30 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-cba5589b-2ab4-4d11-8476-474d31865ce2" returned: 0 in 0.326s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-cba5589b-2ab4-4d11-8476-474d31865ce2" released by "delete_volume" :: held 0.836s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created reservations ['1371b827-3cb3-4f4b-b02b-89320a5caf07', 'e61c508b-9211-447b-a4c2-8d5dbad62393', 'ffbb9bc5-3f6d-4bf3-84f3-87fc00f1a1ee', 'ba65d37f-3dd0-4d28-8ecd-b5cb4089d1f7'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:30 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:30 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (a720f0a0-0c59-4fb7-a8b9-6a6183291d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842573f9-510d-4492-b9ea-3a231a6f69f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842573f9-510d-4492-b9ea-3a231a6f69f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070214843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c380fca2-c5bc-4225-8153-66902d1ea080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:31Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8453168-df0c-4981-a3f6-7717a21738ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8453168-df0c-4981-a3f6-7717a21738ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf43433e-4a18-4fdd-a315-3c9228e9a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf43433e-4a18-4fdd-a315-3c9228e9a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c380fca2-c5bc-4225-8153-66902d1ea080', 'volume_name': 'volume-c380fca2-c5bc-4225-8153-66902d1ea080', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3b1b6a-3c16-4e6e-a8b2-08077e3e6c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3b1b6a-3c16-4e6e-a8b2-08077e3e6c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca09987-87a1-4994-95af-8a23b778ba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:30 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume c380fca2-c5bc-4225-8153-66902d1ea080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c380fca2-c5bc-4225-8153-66902d1ea080', 'volume_size': 1} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070214843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c380fca2-c5bc-4225-8153-66902d1ea080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:31Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Creating volume c380fca2-c5bc-4225-8153-66902d1ea080 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:30 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:30 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:30 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 1073741824 Nov 03 17:13:30 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.587s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:30 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:30 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:30 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Deleted volume successfully. Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-1bc4d01d-fe07-4b30-a627-253b98b58ad8-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-dbc9f993-7c8b-4634-aa94-d26e70cb9a0d tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-cba5589b-2ab4-4d11-8476-474d31865ce2-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-1bc4d01d-fe07-4b30-a627-253b98b58ad8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-quobyte-1bc4d01d-fe07-4b30-a627-253b98b58ad8" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-1bc4d01d-fe07-4b30-a627-253b98b58ad8" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00c6d1d-0e9a-4c24-9f38-d3e297a66af9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:31 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.420s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (340a15b4-9873-4cd6-b65f-54a46ad144f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:31 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 Nov 03 17:13:31 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01f72ce-ad9f-4d48-9d6e-2600d537708e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01f72ce-ad9f-4d48-9d6e-2600d537708e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1993992129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db81fd18-e587-49b6-8818-6da98ec2359a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:31Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760ab3a4-24a2-46af-b5b7-042796788c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760ab3a4-24a2-46af-b5b7-042796788c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62128d70-4b57-4b67-8b73-eb488e0ed0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62128d70-4b57-4b67-8b73-eb488e0ed0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db81fd18-e587-49b6-8818-6da98ec2359a', 'volume_name': 'volume-db81fd18-e587-49b6-8818-6da98ec2359a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e280dc2d-439d-4461-82cf-18178b39d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e280dc2d-439d-4461-82cf-18178b39d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b439190-1dbc-409e-a16f-45ad419bfbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume db81fd18-e587-49b6-8818-6da98ec2359a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db81fd18-e587-49b6-8818-6da98ec2359a', 'volume_size': 1} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:31 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Flow 'volume_create_manager' (deed2e15-09d0-4646-8bc4-cb22612f03e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b726853-c971-46c8-a831-3322d5460b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 1073741824" returned: 0 in 1.025s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b726853-c971-46c8-a831-3322d5460b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-306678698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d5b512-84b0-4794-a20a-685ae40d2d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835516658d8c4365b6b02aa2cb761e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:32Z,use_quota=True,user_id='c3aaf39f0813413fa95c5399215e946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e51abc5-6cc9-484d-bbc1-f463079b7418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e51abc5-6cc9-484d-bbc1-f463079b7418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a54b456-ba1f-48d1-b73d-2d3293c795a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a54b456-ba1f-48d1-b73d-2d3293c795a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d5b512-84b0-4794-a20a-685ae40d2d0e', 'volume_name': 'volume-56d5b512-84b0-4794-a20a-685ae40d2d0e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af88d73-7dd9-4d7a-b88e-94321eba184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af88d73-7dd9-4d7a-b88e-94321eba184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a63d6ca-17a7-4fcb-9d5a-979196f53a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:31 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Volume 56d5b512-84b0-4794-a20a-685ae40d2d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d5b512-84b0-4794-a20a-685ae40d2d0e', 'volume_size': 1} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8" returned: 0 in 0.707s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:32 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8 Nov 03 17:13:32 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:32 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 Nov 03 17:13:32 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (1a5ede6e-2c03-4e11-88e2-9f22657d3d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1989850a-341e-4af6-a702-3350d3b5c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1989850a-341e-4af6-a702-3350d3b5c08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-734999791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a98350-f30b-4929-b485-c934f34cd349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:32Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3436ef-f96f-4e9a-acd0-6c9e03aafb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3436ef-f96f-4e9a-acd0-6c9e03aafb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbd7fb1-1b16-44f2-9978-439dde458b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbd7fb1-1b16-44f2-9978-439dde458b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a98350-f30b-4929-b485-c934f34cd349', 'volume_name': 'volume-28a98350-f30b-4929-b485-c934f34cd349', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4efce41-28c0-4293-80a0-9f8e24c14725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4efce41-28c0-4293-80a0-9f8e24c14725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb598322-d2a6-437a-a13b-074fa4ec7e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:32 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume 28a98350-f30b-4929-b485-c934f34cd349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a98350-f30b-4929-b485-c934f34cd349', 'volume_size': 1} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:32 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:32 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1bc4d01d-fe07-4b30-a627-253b98b58ad8" returned: 0 in 0.390s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080" returned: 0 in 0.354s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-1bc4d01d-fe07-4b30-a627-253b98b58ad8" released by "delete_volume" :: held 1.187s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1993992129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db81fd18-e587-49b6-8818-6da98ec2359a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:31Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Creating volume db81fd18-e587-49b6-8818-6da98ec2359a {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:32 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:32 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a 1073741824 Nov 03 17:13:32 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca09987-87a1-4994-95af-8a23b778ba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c380fca2-c5bc-4225-8153-66902d1ea080', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f9189c-7723-4900-a422-dcec1ff20a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:32 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume volume-c380fca2-c5bc-4225-8153-66902d1ea080 (c380fca2-c5bc-4225-8153-66902d1ea080): created successfully Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f9189c-7723-4900-a422-dcec1ff20a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (a720f0a0-0c59-4fb7-a8b9-6a6183291d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:32 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3f956384-c331-46d0-838e-f61d053d9dbd tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created volume successfully. Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created reservations ['847c1549-b59f-4281-a9c2-f1215db4971f', '0da9f315-ca6f-45dd-8d7e-8b8d1e14497c', 'b15214e1-048b-4e92-8914-129e151c1c0f', '7bb73a63-7712-4b5f-8b26-91d8eb4836f4'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:32 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:32 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:32 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (6ac5d4c4-d2f7-445e-9d4d-6cc7bfa23b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a64bc1-70bd-46a3-aa86-37f51453f6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-ebf1354d-7ebd-4e14-aed0-bc145665d3c1-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a 1073741824" returned: 0 in 0.655s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a64bc1-70bd-46a3-aa86-37f51453f6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331952642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540ea4ef-0076-4416-b2c7-25fe9b2e9368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:33Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97f952a-26b8-4032-ad17-8808a6556940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97f952a-26b8-4032-ad17-8808a6556940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6f2967-b215-46a2-bdd1-be1ec715f7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6f2967-b215-46a2-bdd1-be1ec715f7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540ea4ef-0076-4416-b2c7-25fe9b2e9368', 'volume_name': 'volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565dbbb2-1bdc-4493-a3ad-d7fbc168679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565dbbb2-1bdc-4493-a3ad-d7fbc168679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127a5c30-a9fc-4e00-ba81-6e8ebcb1d018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume 540ea4ef-0076-4416-b2c7-25fe9b2e9368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368', 'volume_size': 1} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-ebf1354d-7ebd-4e14-aed0-bc145665d3c1-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-quobyte-ebf1354d-7ebd-4e14-aed0-bc145665d3c1" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:33 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a Nov 03 17:13:33 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-ebf1354d-7ebd-4e14-aed0-bc145665d3c1" acquired by "delete_volume" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4edb880-d13a-4230-a61d-c6ce26213f89]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:33 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.554s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Deleted volume successfully. Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-83bd0569-2178-4033-9939-ef949bfb7b43 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-1bc4d01d-fe07-4b30-a627-253b98b58ad8-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:33 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 Nov 03 17:13:33 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:33 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (5b3e5fdf-0520-4618-8af4-0fac618197db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9d27a5-07cc-4456-ba97-d34de911b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a" returned: 0 in 0.346s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-306678698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d5b512-84b0-4794-a20a-685ae40d2d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835516658d8c4365b6b02aa2cb761e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:32Z,use_quota=True,user_id='c3aaf39f0813413fa95c5399215e946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Creating volume 56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:33 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9d27a5-07cc-4456-ba97-d34de911b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-164616025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:33Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e 1073741824 Nov 03 17:13:33 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801d577b-747c-49a6-bdf7-266bbfa5b785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801d577b-747c-49a6-bdf7-266bbfa5b785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6113d3-1cdd-4bb7-a9cf-bf8b080c5a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6113d3-1cdd-4bb7-a9cf-bf8b080c5a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc', 'volume_name': 'volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b75084-c747-4104-ab9f-5dc93a870d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b75084-c747-4104-ab9f-5dc93a870d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3de472-1125-420d-8d23-57a395ffd00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume 88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc', 'volume_size': 1} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b439190-1dbc-409e-a16f-45ad419bfbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db81fd18-e587-49b6-8818-6da98ec2359a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34cb95c-197a-4b63-9a00-d707aeb6c2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume volume-db81fd18-e587-49b6-8818-6da98ec2359a (db81fd18-e587-49b6-8818-6da98ec2359a): created successfully Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34cb95c-197a-4b63-9a00-d707aeb6c2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (340a15b4-9873-4cd6-b65f-54a46ad144f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6dd3a1a7-e7b7-4b98-bc3f-b866728b426a tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created volume successfully. Nov 03 17:13:33 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1" returned: 0 in 0.440s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:33 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1 Nov 03 17:13:33 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:34 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-ebf1354d-7ebd-4e14-aed0-bc145665d3c1" returned: 0 in 0.291s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-ebf1354d-7ebd-4e14-aed0-bc145665d3c1" released by "delete_volume" :: held 0.788s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:34 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e 1073741824" returned: 0 in 0.562s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created reservations ['16e476a6-7790-45a5-9d43-fb762481db9b', '1147fb87-65c6-4b4a-8c2e-1b25ce07164c', '98082cce-037c-4010-ab7e-12bab5de912f', 'cbd3f36f-8e91-4616-845d-8aa0a73debed'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:34 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e Nov 03 17:13:34 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:34 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:34 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:34 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:34 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e" returned: 0 in 0.385s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-734999791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a98350-f30b-4929-b485-c934f34cd349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:32Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Creating volume 28a98350-f30b-4929-b485-c934f34cd349 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:34 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.328s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Deleted volume successfully. Nov 03 17:13:34 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 1073741824 Nov 03 17:13:34 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a63d6ca-17a7-4fcb-9d5a-979196f53a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d5b512-84b0-4794-a20a-685ae40d2d0e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415c3734-c39f-4e96-b714-e5026b5fa143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:34 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Volume volume-56d5b512-84b0-4794-a20a-685ae40d2d0e (56d5b512-84b0-4794-a20a-685ae40d2d0e): created successfully Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415c3734-c39f-4e96-b714-e5026b5fa143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Flow 'volume_create_manager' (deed2e15-09d0-4646-8bc4-cb22612f03e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1140cda2-b2b0-406b-bfb0-a5d6eeff6ccf tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-ebf1354d-7ebd-4e14-aed0-bc145665d3c1-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-d6673dbe-6d3e-49ce-85ef-da7bf552795a tempest-VolumeDependencyTests-603838903 None] Created volume successfully. Nov 03 17:13:35 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 1073741824" returned: 0 in 0.523s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:35 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 Nov 03 17:13:35 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-4d4e9831-9a9f-452e-83c7-96eff3ee1a31-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-4d4e9831-9a9f-452e-83c7-96eff3ee1a31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-quobyte-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-quobyte-4d4e9831-9a9f-452e-83c7-96eff3ee1a31" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-4d4e9831-9a9f-452e-83c7-96eff3ee1a31" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Deleting offline snapshot 4d4e9831-9a9f-452e-83c7-96eff3ee1a31 of volume da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] snapshot_file for this snap is: volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16304b6-e263-4d5d-a56f-e3a2f48bd7dc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:35 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 Nov 03 17:13:35 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:35 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349" returned: 0 in 0.303s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.315s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331952642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540ea4ef-0076-4416-b2c7-25fe9b2e9368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:33Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Creating volume 540ea4ef-0076-4416-b2c7-25fe9b2e9368 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:35 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:35 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 1073741824 Nov 03 17:13:35 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb598322-d2a6-437a-a13b-074fa4ec7e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a98350-f30b-4929-b485-c934f34cd349', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a965ca-0779-41e9-98c1-7c4dd47c8245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:35 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume volume-28a98350-f30b-4929-b485-c934f34cd349 (28a98350-f30b-4929-b485-c934f34cd349): created successfully Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a965ca-0779-41e9-98c1-7c4dd47c8245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (1a5ede6e-2c03-4e11-88e2-9f22657d3d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:35 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-64257157-0943-430e-b4f7-b94316757276 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created volume successfully. Nov 03 17:13:35 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31" returned: 0 in 0.464s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9fc06-b80a-43cd-a6e2-d47b58130e71]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:35 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 Nov 03 17:13:35 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:36 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 1073741824" returned: 0 in 0.520s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:36 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 Nov 03 17:13:36 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:36 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" returned: 0 in 0.415s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:36 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 Nov 03 17:13:36 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:36 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368" returned: 0 in 0.302s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.737s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-164616025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4657c92826845fbb2b7b32a70dba761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:33Z,use_quota=True,user_id='621b77da9a3645fc965795efd58596a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Creating volume 88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:36 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127a5c30-a9fc-4e00-ba81-6e8ebcb1d018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:36 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc 1073741824 Nov 03 17:13:36 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2780ed-fcf8-4a96-b65c-49110be56483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:36 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 (540ea4ef-0076-4416-b2c7-25fe9b2e9368): created successfully Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2780ed-fcf8-4a96-b65c-49110be56483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (6ac5d4c4-d2f7-445e-9d4d-6cc7bfa23b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5d42ce35-5788-4df6-86a7-3a89a129d6c1 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created volume successfully. Nov 03 17:13:36 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31" returned: 0 in 0.442s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:36 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31 Nov 03 17:13:36 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:36 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc 1073741824" returned: 0 in 0.581s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:37 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7.4d4e9831-9a9f-452e-83c7-96eff3ee1a31" returned: 0 in 0.334s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:37 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc Nov 03 17:13:37 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-4d4e9831-9a9f-452e-83c7-96eff3ee1a31" released by "_delete_snapshot" :: held 1.800s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" released by "delete_snapshot" :: held 1.827s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created reservations ['0f6e2182-75cc-403f-ad53-933167db61eb', '94c8522c-8ed6-443e-bace-ec9856aaa367', '9da8ccd0-8f06-4045-ac25-14709d5677d0', '7cb1dffe-17fa-4ad2-bf93-d9b699c24064'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Delete snapshot completed successfully. Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ee6aede9-e212-4434-949b-cd73ebe5c19e tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-4d4e9831-9a9f-452e-83c7-96eff3ee1a31-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:37 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc" returned: 0 in 0.330s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.514s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3de472-1125-420d-8d23-57a395ffd00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944c21b5-5c52-4ba5-91e7-ae7dbdaa0c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Creating offline snapshot 1b985d3c-59f2-42e8-948d-4294e57477f7 of volume 56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:13:37 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Volume volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc (88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc): created successfully Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944c21b5-5c52-4ba5-91e7-ae7dbdaa0c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Flow 'volume_create_manager' (5b3e5fdf-0520-4618-8af4-0fac618197db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a6c83-3de1-4eb1-9d23-ecc4471020e0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:37 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7a3e87ab-1019-431d-8a38-f7d3d7eba070 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created volume successfully. Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "cinder-quobyte-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:37 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e Nov 03 17:13:37 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca30d6f-297e-4f0d-9405-492932444c36]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:37 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 Nov 03 17:13:37 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:37 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e" returned: 0 in 0.499s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:37 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:37 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 1G Nov 03 17:13:37 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-quobyte-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a566fe6-baae-4162-81ad-883f60c64cbc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:38 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" returned: 0 in 0.565s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:38 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7 Nov 03 17:13:38 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:38 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc Nov 03 17:13:38 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:38 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" returned: 0 in 0.349s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-quobyte-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7" released by "delete_volume" :: held 1.011s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:38 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 1G" returned: 0 in 0.663s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56d5b512-84b0-4794-a20a-685ae40d2d0e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:38 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56d5b512-84b0-4794-a20a-685ae40d2d0e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 Nov 03 17:13:38 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Created reservations ['fd93f5af-a9b5-4d84-84c3-62f791454f6a', '654507e7-2d28-4147-9b05-3722dd419a85', '867c89c9-1b5e-43e3-91d3-9dbdf29ff24a', 'cfc36a05-91fa-43bb-b88a-cbe17c0b4036'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:38 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc" returned: 0 in 0.589s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:38 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc Nov 03 17:13:38 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:38 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:38 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:39 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56d5b512-84b0-4794-a20a-685ae40d2d0e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7" returned: 0 in 0.422s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:39 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 is being set with open permissions: ugo+rw Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:39 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 Nov 03 17:13:39 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:39 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.345s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Deleted volume successfully. Nov 03 17:13:39 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc" returned: 0 in 0.474s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc" released by "delete_volume" :: held 1.138s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-cff51efa-ccd2-43f1-82a7-8d6c14224669 tempest-CreateVolumesFromSnapshotTest-1128253418 None] Lock "cinder-da137ed7-fdcf-425f-8cfe-bf9fbef1eea7-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created reservations ['574d814e-f915-400f-9b77-d6bab6a1204a', '85e52a47-41aa-445f-913f-617af6637dd4', 'dbc8db1e-2dcf-4ce8-adf2-0795b7ec7f88', 'c6683779-5f3a-4016-bab8-1236888a3197'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:39 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7" returned: 0 in 0.385s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:39 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:39 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:39 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.info Nov 03 17:13:39 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:39 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.311s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Deleted volume successfully. Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-31aa2cd9-3731-4171-93bc-2619846bdbfc tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-88c8fa4f-2f5e-416d-bd6d-f88f747dd4cc-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:39 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.info" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:39 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.info is being set with open permissions: ugo+rw Nov 03 17:13:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:39 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.info Nov 03 17:13:39 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:40 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.info" returned: 0 in 0.311s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:40 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-eb1e827a-880b-46c2-8463-c294b900b54d tempest-VolumeDependencyTests-603838903 None] Create snapshot completed successfully Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-540ea4ef-0076-4416-b2c7-25fe9b2e9368-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-540ea4ef-0076-4416-b2c7-25fe9b2e9368-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-quobyte-540ea4ef-0076-4416-b2c7-25fe9b2e9368" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-540ea4ef-0076-4416-b2c7-25fe9b2e9368" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[539449fe-b76c-43ad-b3bc-711ee8ba5727]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:40 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 Nov 03 17:13:40 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:40 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368" returned: 0 in 0.516s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:41 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368 Nov 03 17:13:41 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:41 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-540ea4ef-0076-4416-b2c7-25fe9b2e9368" returned: 0 in 0.347s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-540ea4ef-0076-4416-b2c7-25fe9b2e9368" released by "delete_volume" :: held 0.923s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created reservations ['e4bc0c49-fb41-4b88-846f-61569444de52', 'feb1a320-890c-47f1-b79c-db118543f1a4', '0d863860-6f30-4703-9e10-84032ef68013', 'eefc1b34-4e1f-4c11-ad86-c4aa2e8499e1'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:41 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:41 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-28a98350-f30b-4929-b485-c934f34cd349-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-28a98350-f30b-4929-b485-c934f34cd349-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:42 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.479s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-quobyte-28a98350-f30b-4929-b485-c934f34cd349" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Deleted volume successfully. Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-28a98350-f30b-4929-b485-c934f34cd349" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-9b215f03-6c6c-404a-b3d0-a17e3cf7888b tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-540ea4ef-0076-4416-b2c7-25fe9b2e9368-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b25cbe0-abdb-4cd5-93c4-d94bd9482ce6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Flow 'volume_create_manager' (41e8e3dd-cf10-4b06-a4e9-894c4bbf2685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e085df-bd51-410e-9d72-2846dacbd7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e085df-bd51-410e-9d72-2846dacbd7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1080175862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059691da-af66-47f0-a24e-febd4cfdba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835516658d8c4365b6b02aa2cb761e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b985d3c-59f2-42e8-948d-4294e57477f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:42Z,use_quota=True,user_id='c3aaf39f0813413fa95c5399215e946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ae9e8e-9a55-4342-b4d0-6788db2dee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ae9e8e-9a55-4342-b4d0-6788db2dee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3c4916-37a3-43a3-8d13-9d873ee8388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3c4916-37a3-43a3-8d13-9d873ee8388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '059691da-af66-47f0-a24e-febd4cfdba8d', 'volume_name': 'volume-059691da-af66-47f0-a24e-febd4cfdba8d', 'volume_size': 1, 'snapshot_id': '1b985d3c-59f2-42e8-948d-4294e57477f7'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:42 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012ba86e-d96d-4867-8b61-0032570228ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:42 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012ba86e-d96d-4867-8b61-0032570228ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac59b2cf-07ca-4f64-9a90-505ca1a41dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:42 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Volume 059691da-af66-47f0-a24e-febd4cfdba8d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-059691da-af66-47f0-a24e-febd4cfdba8d', 'volume_size': 1, 'snapshot_id': '1b985d3c-59f2-42e8-948d-4294e57477f7'} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-quobyte-1b985d3c-59f2-42e8-948d-4294e57477f7-059691da-af66-47f0-a24e-febd4cfdba8d" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-1b985d3c-59f2-42e8-948d-4294e57477f7-059691da-af66-47f0-a24e-febd4cfdba8d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Creating volume 059691da-af66-47f0-a24e-febd4cfdba8d from snapshot 1b985d3c-59f2-42e8-948d-4294e57477f7 {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-quobyte-059691da-af66-47f0-a24e-febd4cfdba8d" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-059691da-af66-47f0-a24e-febd4cfdba8d" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] snapshot: 1b985d3c-59f2-42e8-948d-4294e57477f7, volume: 059691da-af66-47f0-a24e-febd4cfdba8d, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cefe9c-00b5-4121-8088-fa70e5835b7f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:42 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 Nov 03 17:13:42 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:42 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349" returned: 0 in 0.451s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:42 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349 Nov 03 17:13:42 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:42 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:42 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-28a98350-f30b-4929-b485-c934f34cd349" returned: 0 in 0.309s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7" returned: 0 in 0.476s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56d5b512-84b0-4794-a20a-685ae40d2d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-28a98350-f30b-4929-b485-c934f34cd349" released by "delete_volume" :: held 0.829s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9297e6c-5c94-4f1b-9419-07ba28541761]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:42 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created reservations ['087de90b-275e-492d-9f6c-2bdda78acba3', '655afcd2-519e-4f63-9297-deb91932438a', '82797073-98ec-4b5a-80b0-8756f4f913a7', '467a65e4-95a4-44f4-aeb1-6353107f6e31'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:43 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e Nov 03 17:13:43 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:43 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:43 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-db81fd18-e587-49b6-8818-6da98ec2359a-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-db81fd18-e587-49b6-8818-6da98ec2359a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-quobyte-db81fd18-e587-49b6-8818-6da98ec2359a" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-db81fd18-e587-49b6-8818-6da98ec2359a" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc92c5d9-5e4f-4664-af46-14351cc29314]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:43 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e" returned: 0 in 0.612s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:43 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a Nov 03 17:13:43 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:43 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.454s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:43 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Deleted volume successfully. Nov 03 17:13:43 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d Nov 03 17:13:43 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-bb78fb91-2075-496a-a755-3aa51612d865 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-28a98350-f30b-4929-b485-c934f34cd349-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:43 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a" returned: 0 in 0.487s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:43 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a Nov 03 17:13:43 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:44 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-db81fd18-e587-49b6-8818-6da98ec2359a" returned: 0 in 0.377s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-db81fd18-e587-49b6-8818-6da98ec2359a" released by "delete_volume" :: held 0.937s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created reservations ['f543e4ab-2621-44cd-bd0f-e347803d025d', '47251a2d-abdc-4fd9-94ae-d51912df2868', '82f66aee-6455-40ad-8927-ac3b831e2319', '3ed4fb33-d1bd-4fe1-be9d-6c7264085ed6'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:44 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:44 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:45 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-73372dc3-1e36-46ae-9588-de4f5121d997 tempest-ProjectAdminTests-878169264 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7029113769531, 'free_capacity_gb': 1773.7029113769531, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86939) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 17:13:45 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 1.099s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:45 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Deleted volume successfully. Nov 03 17:13:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-c380fca2-c5bc-4225-8153-66902d1ea080-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e5c34b55-42fa-4e05-b51a-f775f3727b67 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-db81fd18-e587-49b6-8818-6da98ec2359a-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-c380fca2-c5bc-4225-8153-66902d1ea080-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-quobyte-c380fca2-c5bc-4225-8153-66902d1ea080" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-c380fca2-c5bc-4225-8153-66902d1ea080" acquired by "delete_volume" :: waited 0.068s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:46 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cd834e-d2ad-4271-991a-cf319a73cbd2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:46 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 Nov 03 17:13:46 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:47 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080" returned: 0 in 1.022s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:47 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080 Nov 03 17:13:47 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:47 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-c380fca2-c5bc-4225-8153-66902d1ea080" returned: 0 in 0.686s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-c380fca2-c5bc-4225-8153-66902d1ea080" released by "delete_volume" :: held 1.850s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:47 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created reservations ['11589cf9-b5b4-4e5b-a5c1-d80ff0164a9d', 'ad0c00fd-5c42-4e2b-b828-3d79ad935809', '0fd67819-15a4-427f-a2b3-c3027f071b36', 'e073b73f-133e-495b-828d-0d0a85067fd2'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:48 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:48 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-12b6872a-8411-4f56-805e-92663e348155-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-12b6872a-8411-4f56-805e-92663e348155-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "cinder-quobyte-12b6872a-8411-4f56-805e-92663e348155" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-12b6872a-8411-4f56-805e-92663e348155" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[795710d8-b69b-4139-b3e1-b90719a5e18d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:48 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.758s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:48 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:48 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Deleted volume successfully. Nov 03 17:13:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-62f0898b-ec68-46ca-a56a-786e9cab9fb4 tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-c380fca2-c5bc-4225-8153-66902d1ea080-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:49 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 Nov 03 17:13:49 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:49 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155" returned: 0 in 1.071s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:49 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155 Nov 03 17:13:49 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:50 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-12b6872a-8411-4f56-805e-92663e348155" returned: 0 in 0.647s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-quobyte-12b6872a-8411-4f56-805e-92663e348155" released by "delete_volume" :: held 1.848s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Created reservations ['a9accd49-ead2-4203-9260-31f545dd5690', '658b3831-e935-48ea-befe-954a9dbb2586', 'a4bafce1-16fc-47b2-9009-9bdcee34572f', 'cdc433da-1a4d-4184-9f44-4091b899660d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:50 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:50 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:51 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.518s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:51 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:51 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Deleted volume successfully. Nov 03 17:13:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-19248651-43f7-4af1-80ac-6684a3f52f5d tempest-CreateVolumesFromSourceVolumeTest-585512439 None] Lock "cinder-12b6872a-8411-4f56-805e-92663e348155-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:53 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d" returned: 0 in 10.100s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:53 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e, size 1024.00 MB, duration 10.10 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:13:53 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Converted 1024.00 MB image at 101.38 MB/s Nov 03 17:13:53 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d is being set with open permissions: ugo+rw Nov 03 17:13:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:53 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d Nov 03 17:13:53 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:53 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d" returned: 0 in 0.354s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-059691da-af66-47f0-a24e-febd4cfdba8d" released by "_copy_volume_from_snapshot" :: held 11.676s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-1b985d3c-59f2-42e8-948d-4294e57477f7-059691da-af66-47f0-a24e-febd4cfdba8d" released by "_create_volume_from_snapshot" :: held 11.761s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.783s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac59b2cf-07ca-4f64-9a90-505ca1a41dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059691da-af66-47f0-a24e-febd4cfdba8d', 'volume_size': 1, 'snapshot_id': '1b985d3c-59f2-42e8-948d-4294e57477f7'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4bc722-cfb6-4c27-b1f1-de0638993efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:54 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Volume volume-059691da-af66-47f0-a24e-febd4cfdba8d (059691da-af66-47f0-a24e-febd4cfdba8d): created successfully Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4bc722-cfb6-4c27-b1f1-de0638993efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Flow 'volume_create_manager' (41e8e3dd-cf10-4b06-a4e9-894c4bbf2685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-fa3f312a-0e4f-4db4-a1a6-659b5e4b56c7 tempest-VolumeDependencyTests-603838903 None] Created volume successfully. Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-1b985d3c-59f2-42e8-948d-4294e57477f7-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Lock "cinder-1b985d3c-59f2-42e8-948d-4294e57477f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-quobyte-56d5b512-84b0-4794-a20a-685ae40d2d0e" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-56d5b512-84b0-4794-a20a-685ae40d2d0e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-quobyte-1b985d3c-59f2-42e8-948d-4294e57477f7" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-1b985d3c-59f2-42e8-948d-4294e57477f7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Deleting offline snapshot 1b985d3c-59f2-42e8-948d-4294e57477f7 of volume 56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] snapshot_file for this snap is: volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fe2563-dbbc-4e93-b3d1-4553ad9a3afe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:55 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 Nov 03 17:13:55 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:55 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7" returned: 0 in 0.570s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56d5b512-84b0-4794-a20a-685ae40d2d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:13:55 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a49b4-06c8-4d52-85a9-9522204ed14b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:55 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e Nov 03 17:13:55 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:56 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e" returned: 0 in 0.821s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:56 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 Nov 03 17:13:56 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Flow 'volume_create_manager' (eef25a8b-13d2-448c-909d-d3e085ebab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa79cae8-eeb5-4f5d-8d21-3acd5eadb612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa79cae8-eeb5-4f5d-8d21-3acd5eadb612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57a7305-5154-4c64-a322-8054dc9176c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015cb095b0a24cc48e8ed7ef226f3c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='78d8082ec3dc4c37b3edbac6d1c12afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b84d49-2522-4792-b72e-fdb00f3555c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b84d49-2522-4792-b72e-fdb00f3555c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360a91fe-3ae1-4baa-a808-ac9b5edfc269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360a91fe-3ae1-4baa-a808-ac9b5edfc269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57a7305-5154-4c64-a322-8054dc9176c0', 'volume_name': 'volume-d57a7305-5154-4c64-a322-8054dc9176c0', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99be5c2d-e5b8-480b-b32f-58a47490293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99be5c2d-e5b8-480b-b32f-58a47490293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7af54b-0138-49e0-8049-c0dd7f7b03a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:56 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Volume d57a7305-5154-4c64-a322-8054dc9176c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57a7305-5154-4c64-a322-8054dc9176c0', 'volume_size': 1} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57a7305-5154-4c64-a322-8054dc9176c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015cb095b0a24cc48e8ed7ef226f3c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:56Z,use_quota=True,user_id='78d8082ec3dc4c37b3edbac6d1c12afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Creating volume d57a7305-5154-4c64-a322-8054dc9176c0 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:56 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:56 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 1073741824 Nov 03 17:13:56 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:56 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7" returned: 0 in 0.445s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:56 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7 Nov 03 17:13:56 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:57 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e.1b985d3c-59f2-42e8-948d-4294e57477f7" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-1b985d3c-59f2-42e8-948d-4294e57477f7" released by "_delete_snapshot" :: held 2.423s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-56d5b512-84b0-4794-a20a-685ae40d2d0e" released by "delete_snapshot" :: held 2.454s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:57 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 1073741824" returned: 0 in 0.671s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Created reservations ['a892949f-a51e-43c3-9fe7-ee91ca24d7d3', '5e48a92a-68d5-4ae6-9f40-c30567f72f22', '678381e3-1b16-4cd6-ac43-14f7be90e7b8', 'b06f12a6-f58b-44eb-8148-9baf321af72f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:57 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 Nov 03 17:13:57 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Delete snapshot completed successfully. Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-98763d0c-cbcf-4065-a2be-ae33d141609d tempest-VolumeDependencyTests-603838903 None] Lock "cinder-1b985d3c-59f2-42e8-948d-4294e57477f7-delete_snapshot" released by "delete_snapshot" :: held 2.665s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:57 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0" returned: 0 in 0.294s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7af54b-0138-49e0-8049-c0dd7f7b03a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57a7305-5154-4c64-a322-8054dc9176c0', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81c97c0-baeb-4851-8a49-27e0b71cae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:57 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Volume volume-d57a7305-5154-4c64-a322-8054dc9176c0 (d57a7305-5154-4c64-a322-8054dc9176c0): created successfully Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81c97c0-baeb-4851-8a49-27e0b71cae28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Flow 'volume_create_manager' (eef25a8b-13d2-448c-909d-d3e085ebab53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7880fbe5-0144-4190-8326-bb16fba8ac70 tempest-CinderUnicodeTest-1771276786 None] Created volume successfully. Nov 03 17:13:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-56d5b512-84b0-4794-a20a-685ae40d2d0e-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Lock "cinder-56d5b512-84b0-4794-a20a-685ae40d2d0e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-quobyte-56d5b512-84b0-4794-a20a-685ae40d2d0e" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-56d5b512-84b0-4794-a20a-685ae40d2d0e" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:58 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee75e00-2b2b-4a46-b9e0-426b17bf83be]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:58 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e Nov 03 17:13:58 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:59 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e" returned: 0 in 0.786s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:59 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e Nov 03 17:13:59 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Flow 'volume_create_manager' (495ae971-5ccc-4867-a8fe-e736916d07a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c754f0-fe9a-4267-aba1-60c02288fe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c754f0-fe9a-4267-aba1-60c02288fe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1655738456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90e9f6f-cc0b-4c19-b2f5-793ab6093006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015cb095b0a24cc48e8ed7ef226f3c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:59Z,use_quota=True,user_id='78d8082ec3dc4c37b3edbac6d1c12afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90da28f3-82af-463b-8455-f3610a832821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90da28f3-82af-463b-8455-f3610a832821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9428571f-7042-465c-acb9-03f430bd60f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9428571f-7042-465c-acb9-03f430bd60f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90e9f6f-cc0b-4c19-b2f5-793ab6093006', 'volume_name': 'volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0de83f-c76f-4b78-8007-d7af213bc233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0de83f-c76f-4b78-8007-d7af213bc233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0e7093-5464-4922-acdd-d21180daed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Volume d90e9f6f-cc0b-4c19-b2f5-793ab6093006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006', 'volume_size': 1} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1655738456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90e9f6f-cc0b-4c19-b2f5-793ab6093006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015cb095b0a24cc48e8ed7ef226f3c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:59Z,use_quota=True,user_id='78d8082ec3dc4c37b3edbac6d1c12afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Creating volume d90e9f6f-cc0b-4c19-b2f5-793ab6093006 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:59 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:59 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 1073741824 Nov 03 17:13:59 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:59 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-56d5b512-84b0-4794-a20a-685ae40d2d0e" returned: 0 in 0.410s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-56d5b512-84b0-4794-a20a-685ae40d2d0e" released by "delete_volume" :: held 1.315s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Created reservations ['4fe031ab-529f-4de8-8b50-bef11cd6f7a2', '2a9421b0-3ce5-4f0f-9078-70bc47f1b1af', 'f8cf903c-442e-4f28-b118-eed61d70afd7', '9e9bb2d9-1bae-410c-8b62-40bcfcb5635a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:59 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:13:59 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:00 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 1073741824" returned: 0 in 0.678s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:00 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.384s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Deleted volume successfully. Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-2f56be99-46ab-4ef6-b03c-aeffaa3eb5dc tempest-VolumeDependencyTests-603838903 None] Lock "cinder-56d5b512-84b0-4794-a20a-685ae40d2d0e-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:00 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 Nov 03 17:14:00 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-059691da-af66-47f0-a24e-febd4cfdba8d-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:00 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Lock "cinder-059691da-af66-47f0-a24e-febd4cfdba8d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" returned: 0 in 0.340s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0e7093-5464-4922-acdd-d21180daed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944de5c6-b7ee-470f-abd7-9be4ef5ab76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:00 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Volume volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 (d90e9f6f-cc0b-4c19-b2f5-793ab6093006): created successfully Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944de5c6-b7ee-470f-abd7-9be4ef5ab76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Flow 'volume_create_manager' (495ae971-5ccc-4867-a8fe-e736916d07a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Acquiring lock "cinder-quobyte-059691da-af66-47f0-a24e-febd4cfdba8d" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-0a860274-74f5-4110-bce7-bc8acd6f769d tempest-CinderUnicodeTest-1771276786 None] Created volume successfully. Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-059691da-af66-47f0-a24e-febd4cfdba8d" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f1e6fe-b5c0-489e-a2eb-a8a7444e5c48]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:00 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d Nov 03 17:14:00 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:01 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d" returned: 0 in 0.588s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:01 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d Nov 03 17:14:01 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:01 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-059691da-af66-47f0-a24e-febd4cfdba8d" returned: 0 in 0.377s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Lock "cinder-quobyte-059691da-af66-47f0-a24e-febd4cfdba8d" released by "delete_volume" :: held 1.034s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:01 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Created reservations ['fa9acca9-46b7-41b1-bcc7-477488c6627e', 'bb249499-3250-4c9b-a157-1710263beb5a', '31cdf9d1-c681-43da-9473-48a8edac6463', 'abe45a9c-a644-4383-ac41-d584ac922123'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Creating offline snapshot 367d0323-4e72-4bae-b1b4-ce807e28ae4c of volume d90e9f6f-cc0b-4c19-b2f5-793ab6093006 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3039a0a-4a0e-424a-80fc-41f3ef482bf4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:02 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:02 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:02 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 Nov 03 17:14:02 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (8d7f366f-aa83-4842-994f-09aa3f1e3883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:02 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6597c1d7-7135-4164-957b-872d11b2bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.398s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:02 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Deleted volume successfully. Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6597c1d7-7135-4164-957b-872d11b2bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121935246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:02Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a639700b-e526-46c1-97b7-9ba8a9f38187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a639700b-e526-46c1-97b7-9ba8a9f38187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027ab7f4-36d4-4dfa-a4ae-ae2fc3d36a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027ab7f4-36d4-4dfa-a4ae-ae2fc3d36a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d', 'volume_name': 'volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a648bc9d-871a-4dc5-9101-48eca3a89e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a648bc9d-871a-4dc5-9101-48eca3a89e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c18bdc-0bdc-4bf3-95e5-6bff8ee418dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:02 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Volume 39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d', 'volume_size': 1} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ba02e0dc-e9f1-4b01-a5fd-b5befe5ab547 tempest-VolumeDependencyTests-603838903 None] Lock "cinder-059691da-af66-47f0-a24e-febd4cfdba8d-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:02 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" returned: 0 in 0.599s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:02 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c 1G Nov 03 17:14:02 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:03 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c 1G" returned: 0 in 0.551s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:03 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c Nov 03 17:14:03 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:03 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c" returned: 0 in 0.422s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:03 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c is being set with open permissions: ugo+rw Nov 03 17:14:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:03 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c Nov 03 17:14:03 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c" returned: 0 in 0.357s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=248,cinder:SELECT=179,cinder:INSERT=74,cinder:DELETE=20 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:04 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.info Nov 03 17:14:04 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.info" returned: 0 in 0.377s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:04 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.info is being set with open permissions: ugo+rw Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:04 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.info Nov 03 17:14:04 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.info" returned: 0 in 0.303s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.169s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121935246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:02Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Creating volume 39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:04 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:04 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d 1073741824 Nov 03 17:14:04 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-88e5d74d-d8c3-4357-b40f-287af0fdfd3f tempest-CinderUnicodeTest-1771276786 None] Create snapshot completed successfully Nov 03 17:14:04 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=194,cinder:UPDATE=264,cinder:DELETE=27,cinder:INSERT=63 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "cinder-367d0323-4e72-4bae-b1b4-ce807e28ae4c-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-367d0323-4e72-4bae-b1b4-ce807e28ae4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "cinder-quobyte-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-quobyte-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "cinder-quobyte-367d0323-4e72-4bae-b1b4-ce807e28ae4c" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-quobyte-367d0323-4e72-4bae-b1b4-ce807e28ae4c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Deleting offline snapshot 367d0323-4e72-4bae-b1b4-ce807e28ae4c of volume d90e9f6f-cc0b-4c19-b2f5-793ab6093006 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] snapshot_file for this snap is: volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b73d65e-9968-44ac-a69b-5563df34a2ed]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:05 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d 1073741824" returned: 0 in 0.698s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:05 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c Nov 03 17:14:05 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:05 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d Nov 03 17:14:05 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:05 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" returned: 0 in 0.366s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c18bdc-0bdc-4bf3-95e5-6bff8ee418dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfb5e21-0ecc-4245-a5fd-411bf1db5bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:05 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c" returned: 0 in 0.591s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:06 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Volume volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d (39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d): created successfully Nov 03 17:14:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfb5e21-0ecc-4245-a5fd-411bf1db5bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (8d7f366f-aa83-4842-994f-09aa3f1e3883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:06 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c6a8c5-28b3-4365-bbbf-57dc4419ce71]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-86309ca7-8f06-4be4-8fea-b9e144f6757b tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:14:06 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 Nov 03 17:14:06 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:06 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" returned: 0 in 0.492s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:06 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c Nov 03 17:14:06 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:07 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c" returned: 0 in 0.456s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:07 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c Nov 03 17:14:07 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:07 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006.367d0323-4e72-4bae-b1b4-ce807e28ae4c" returned: 0 in 0.334s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-quobyte-367d0323-4e72-4bae-b1b4-ce807e28ae4c" released by "_delete_snapshot" :: held 2.060s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-quobyte-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" released by "delete_snapshot" :: held 2.103s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Created reservations ['cd1d4d52-2913-4e6e-9978-9619f28f8d57', '5c47a039-d35f-4f26-8d1f-651b95a45ea3', '1c8550e3-04f7-4cb0-8f37-ffb765db4e67', '60d53575-4235-4faf-9ffd-585da1dae1ea'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Creating offline snapshot 968fe5ea-48c5-4c56-80d1-64360cf90daa of volume 39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f427b-53b4-4ef5-a278-b344c3f66736]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Delete snapshot completed successfully. Nov 03 17:14:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-75b57031-33aa-4b3e-a3cc-56c2e2bc858b tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-367d0323-4e72-4bae-b1b4-ce807e28ae4c-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:07 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d Nov 03 17:14:07 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:08 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" returned: 0 in 0.555s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:08 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa 1G Nov 03 17:14:08 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "cinder-d90e9f6f-cc0b-4c19-b2f5-793ab6093006-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-d90e9f6f-cc0b-4c19-b2f5-793ab6093006-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "cinder-quobyte-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-quobyte-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" acquired by "delete_volume" :: waited 0.034s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:08 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1d96af-a6aa-47e1-85e6-9532fcd6046f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:09 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa 1G" returned: 0 in 0.769s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:09 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa Nov 03 17:14:09 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:09 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 Nov 03 17:14:09 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:09 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" returned: 0 in 0.565s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:09 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa" returned: 0 in 0.453s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:09 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa is being set with open permissions: ugo+rw Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:09 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006 Nov 03 17:14:09 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:09 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa Nov 03 17:14:09 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:09 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" returned: 0 in 0.330s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-quobyte-d90e9f6f-cc0b-4c19-b2f5-793ab6093006" released by "delete_volume" :: held 1.011s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:09 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa" returned: 0 in 0.384s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:09 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Created reservations ['3609b6a7-c999-4c8e-abb0-5176b9588526', '5fa184eb-6436-4d04-8d6f-75c04b7994da', 'ebd3ab0f-c783-46b0-8140-8756243c5d34', '52896e75-b9c1-4bd3-a064-788db4e24845'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:09 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.info Nov 03 17:14:09 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:10 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:10 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:10 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.info" returned: 0 in 0.390s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:10 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.info is being set with open permissions: ugo+rw Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:10 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.info Nov 03 17:14:10 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:10 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.329s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:10 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Deleted volume successfully. Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-80219ae3-740f-4621-8a5f-ed1e2dad5a82 tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-d90e9f6f-cc0b-4c19-b2f5-793ab6093006-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:10 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.info" returned: 0 in 0.319s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:10 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-51f98f16-e6ed-4f4b-b1fb-e6dfefb501d1 tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-968fe5ea-48c5-4c56-80d1-64360cf90daa-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Lock "cinder-968fe5ea-48c5-4c56-80d1-64360cf90daa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-968fe5ea-48c5-4c56-80d1-64360cf90daa" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-968fe5ea-48c5-4c56-80d1-64360cf90daa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot 968fe5ea-48c5-4c56-80d1-64360cf90daa of volume 39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3b7b2-4100-4bbb-a00b-d813a39a694e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "cinder-d57a7305-5154-4c64-a322-8054dc9176c0-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-d57a7305-5154-4c64-a322-8054dc9176c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:11 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa Nov 03 17:14:11 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "cinder-quobyte-d57a7305-5154-4c64-a322-8054dc9176c0" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-quobyte-d57a7305-5154-4c64-a322-8054dc9176c0" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2ad0da-092f-460b-a6e6-3f95bdf3183d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:11 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 Nov 03 17:14:11 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:11 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa" returned: 0 in 0.598s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8d9794-3f63-4403-afb3-4bf259a92049]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:11 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0" returned: 0 in 0.510s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:11 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d Nov 03 17:14:11 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:11 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0 Nov 03 17:14:11 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:12 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:12 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-d57a7305-5154-4c64-a322-8054dc9176c0" returned: 0 in 0.387s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" returned: 0 in 0.554s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-quobyte-d57a7305-5154-4c64-a322-8054dc9176c0" released by "delete_volume" :: held 0.978s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:12 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa Nov 03 17:14:12 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Created reservations ['876269b6-81ff-4a2e-b1ad-37afd33df0c1', '348e6a93-e72a-4a43-867a-61b6cd6cf1ba', 'b7bb596f-2d4d-4016-9f2a-38f8b7f2ab89', 'f242ea8e-2d5c-44a1-9631-901358749b97'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:12 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:12 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:12 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa" returned: 0 in 0.534s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:12 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa Nov 03 17:14:12 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:12 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.337s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:12 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Deleted volume successfully. Nov 03 17:14:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-039a48c5-4f6d-40de-bcfa-e15f1f58ed4c tempest-CinderUnicodeTest-1771276786 None] Lock "cinder-d57a7305-5154-4c64-a322-8054dc9176c0-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:13 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d.968fe5ea-48c5-4c56-80d1-64360cf90daa" returned: 0 in 0.339s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-968fe5ea-48c5-4c56-80d1-64360cf90daa" released by "_delete_snapshot" :: held 2.208s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" released by "delete_snapshot" :: held 2.241s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:13 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Created reservations ['3d22021e-3b3a-4180-b3f7-e28e4bf9c4ce', 'badf31fb-2f41-4270-9839-64406386c36d', '23801894-ea7a-4bcc-a1ed-527099f6f5c5', '9660819a-afa9-413a-bb3c-368e8be35295'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:14:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-74937e07-d35f-450f-a327-c5900ec44e9d tempest-ProjectMemberTests-864696047 None] Lock "cinder-968fe5ea-48c5-4c56-80d1-64360cf90daa-delete_snapshot" released by "delete_snapshot" :: held 2.478s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Lock "cinder-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6342927-90c8-46bb-8222-3b64dad46163]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:14 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d Nov 03 17:14:14 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:14 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" returned: 0 in 0.473s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:14 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d Nov 03 17:14:14 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:15 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" returned: 0 in 0.342s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d" released by "delete_volume" :: held 0.929s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Created reservations ['8a16a661-2f26-42f9-ba0d-ec6e4667aa48', 'cfda8d0a-cfc5-4d02-bb9c-95d0fea89893', 'c0042f97-57bd-41a9-8bb9-671324412ef0', '36ce4482-ee8f-4a8c-a776-e66af1c5c4c7'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:15 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:15 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:15 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.427s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:15 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:15 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:14:16 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4ab8d563-adc3-4fca-abdf-eb3544fceb12 tempest-ProjectMemberTests-864696047 None] Lock "cinder-39f997f9-2e26-4b63-a9f9-7f5ad5ad3c8d-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (77d73f5d-ea7a-4dcc-912f-6e6a47972bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9f6f06-dbef-44b0-b473-477773baf341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9f6f06-dbef-44b0-b473-477773baf341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-353865622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:17Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22d3ed0-8a58-4b97-93a8-ce2e34eeb09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22d3ed0-8a58-4b97-93a8-ce2e34eeb09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb791ceb-114b-40b8-ae4d-6f5dd4f5a0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb791ceb-114b-40b8-ae4d-6f5dd4f5a0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d', 'volume_name': 'volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7007603d-10a1-43ab-96d5-03ed0dd8e077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7007603d-10a1-43ab-96d5-03ed0dd8e077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0fe308-0f1f-425b-accf-233d579c9266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Volume a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d', 'volume_size': 1} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-353865622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:17Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Creating volume a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:17 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:17 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d 1073741824 Nov 03 17:14:17 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:18 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d 1073741824" returned: 0 in 0.821s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:18 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d Nov 03 17:14:18 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:18 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (0123f94c-befd-4113-87cf-151fc55bba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64a2c84-9278-444f-9201-40ac87b76d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:19 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" returned: 0 in 0.514s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64a2c84-9278-444f-9201-40ac87b76d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102370685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b0f761-c61f-48c9-bf28-89ac5d2197c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:19Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119ad779-7d33-4dd0-8fb7-b0df2168234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119ad779-7d33-4dd0-8fb7-b0df2168234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b255bf-f00e-446b-8b96-490f2434551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b255bf-f00e-446b-8b96-490f2434551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b0f761-c61f-48c9-bf28-89ac5d2197c5', 'volume_name': 'volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a6931-89b7-4318-bf87-b72570691481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a6931-89b7-4318-bf87-b72570691481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2624feaf-5c58-4535-a955-0fbba1cd1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Volume 57b0f761-c61f-48c9-bf28-89ac5d2197c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5', 'volume_size': 1} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102370685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b0f761-c61f-48c9-bf28-89ac5d2197c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:19Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Creating volume 57b0f761-c61f-48c9-bf28-89ac5d2197c5 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:19 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:19 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 1073741824 Nov 03 17:14:19 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0fe308-0f1f-425b-accf-233d579c9266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b62dcc0-d670-4243-9962-cd4d0b742584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:19 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Volume volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d (a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d): created successfully Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b62dcc0-d670-4243-9962-cd4d0b742584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (77d73f5d-ea7a-4dcc-912f-6e6a47972bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b3e11c81-8621-47ce-8209-9770e3a143d4 tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:14:19 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 1073741824" returned: 0 in 0.663s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:19 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 Nov 03 17:14:19 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:20 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5" returned: 0 in 0.352s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.329s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Creating offline snapshot 7ebffe8a-d8ec-477a-ac09-e8b786c2172e of volume a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2624feaf-5c58-4535-a955-0fbba1cd1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530bd05b-0921-4232-992e-f28ce28325d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eef8e4-1021-4ed7-9f13-6c34573307c5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:20 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Volume volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 (57b0f761-c61f-48c9-bf28-89ac5d2197c5): created successfully Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530bd05b-0921-4232-992e-f28ce28325d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (0123f94c-befd-4113-87cf-151fc55bba30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2f478671-9558-4d9c-a46e-b9408c68c10e tempest-ProjectReaderTests-782803858 None] Created volume successfully. Nov 03 17:14:20 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d Nov 03 17:14:20 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:20 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" returned: 0 in 0.533s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:20 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e 1G Nov 03 17:14:20 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:21 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e 1G" returned: 0 in 0.561s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:21 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e Nov 03 17:14:21 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:21 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:21 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e is being set with open permissions: ugo+rw Nov 03 17:14:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:21 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e Nov 03 17:14:21 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:22 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e" returned: 0 in 0.309s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:22 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.info Nov 03 17:14:22 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:22 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.info" returned: 0 in 0.322s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:22 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.info is being set with open permissions: ugo+rw Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:22 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.info Nov 03 17:14:22 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:22 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.info" returned: 0 in 0.294s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.477s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Creating offline snapshot 5d3512f4-9e12-4f6d-81ec-901b02a0afe7 of volume 57b0f761-c61f-48c9-bf28-89ac5d2197c5 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:22 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-eac99af8-9203-4b02-947c-925eee3620ee tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c8671a-9974-46a9-ba10-3667c1a2ff66]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:23 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 Nov 03 17:14:23 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-7ebffe8a-d8ec-477a-ac09-e8b786c2172e-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Lock "cinder-7ebffe8a-d8ec-477a-ac09-e8b786c2172e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-7ebffe8a-d8ec-477a-ac09-e8b786c2172e" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-7ebffe8a-d8ec-477a-ac09-e8b786c2172e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot 7ebffe8a-d8ec-477a-ac09-e8b786c2172e of volume a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98b4079-f4f4-4e4c-90bd-d6ee512c731e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:23 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5" returned: 0 in 0.528s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:23 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 1G Nov 03 17:14:23 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:23 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e Nov 03 17:14:23 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:23 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e" returned: 0 in 0.568s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[10621d1c-944b-4088-915c-e349634e354f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:24 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 1G" returned: 0 in 0.659s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:24 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d Nov 03 17:14:24 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:24 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 Nov 03 17:14:24 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:24 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" returned: 0 in 0.423s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:24 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e Nov 03 17:14:24 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:24 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7" returned: 0 in 0.396s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:24 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 is being set with open permissions: ugo+rw Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:24 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 Nov 03 17:14:24 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:24 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7" returned: 0 in 0.363s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:24 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e" returned: 0 in 0.466s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:24 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e Nov 03 17:14:24 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:24 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.info Nov 03 17:14:24 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Flow 'volume_create_manager' (09fc68e3-2cbc-4eed-93ad-a6e6cb644698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07081e27-5341-4234-bdf8-32ffe79ad30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07081e27-5341-4234-bdf8-32ffe79ad30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1939487099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3276f91d-8e82-498b-a412-482881842c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d066873ded4475910513d84be72b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:25Z,use_quota=True,user_id='465ebce1b1ed4a9380b2b7cc0a1cf21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b91f24-e6eb-499a-80c3-61862a355b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b91f24-e6eb-499a-80c3-61862a355b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852ac1cb-0c12-442b-831e-9bda4a6553a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852ac1cb-0c12-442b-831e-9bda4a6553a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3276f91d-8e82-498b-a412-482881842c42', 'volume_name': 'volume-3276f91d-8e82-498b-a412-482881842c42', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd0acf4-3b45-4980-a5b4-ddbbc5ba8307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd0acf4-3b45-4980-a5b4-ddbbc5ba8307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29d2c62-c70e-4102-bd8e-1e470a89142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Volume 3276f91d-8e82-498b-a412-482881842c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3276f91d-8e82-498b-a412-482881842c42', 'volume_size': 1} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:25 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d.7ebffe8a-d8ec-477a-ac09-e8b786c2172e" returned: 0 in 0.320s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:25 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.info" returned: 0 in 0.328s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:25 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.info is being set with open permissions: ugo+rw Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-7ebffe8a-d8ec-477a-ac09-e8b786c2172e" released by "_delete_snapshot" :: held 1.941s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" released by "delete_snapshot" :: held 1.983s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:25 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.info Nov 03 17:14:25 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Created reservations ['47b4fbf1-b7ae-42ff-9202-fabf554480c2', '29b270fc-d5d4-4bfe-92c8-f76363d5aa82', '0a62d799-36dc-4f4f-ad36-de1e3dc9043c', '6cee5625-e51b-4833-a1a0-b78a871e7da9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-64a1ea7f-6a92-444c-a9f9-cb4b3fda1968 tempest-ProjectMemberTests-864696047 None] Lock "cinder-7ebffe8a-d8ec-477a-ac09-e8b786c2172e-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:25 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.info" returned: 0 in 0.289s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.433s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1939487099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3276f91d-8e82-498b-a412-482881842c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d066873ded4475910513d84be72b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:25Z,use_quota=True,user_id='465ebce1b1ed4a9380b2b7cc0a1cf21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Creating volume 3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:25 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:25 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 1073741824 Nov 03 17:14:25 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b226a75b-3fe9-47e5-9306-ac470ccda99f tempest-ProjectReaderTests-782803858 None] Create snapshot completed successfully Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Flow 'volume_create_manager' (10036f0d-00e6-4b3d-bc3a-644c106411af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d011f1-08a6-4449-b2a9-e5c416f37d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d011f1-08a6-4449-b2a9-e5c416f37d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722509203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212536a3-6d7c-4a42-9327-22bad94bd438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74af5a9a46b4abe9ab42d688a3fe966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:26Z,use_quota=True,user_id='b99dbdc9577c41e49e2f13ce6e172ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faab48fc-6f4b-41b8-801b-42363a698cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faab48fc-6f4b-41b8-801b-42363a698cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25524ab3-c0c8-49da-b786-072ec4d2a77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25524ab3-c0c8-49da-b786-072ec4d2a77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212536a3-6d7c-4a42-9327-22bad94bd438', 'volume_name': 'volume-212536a3-6d7c-4a42-9327-22bad94bd438', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f2299d-1357-4054-b54c-20a6856d8359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f2299d-1357-4054-b54c-20a6856d8359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c7cbee-e4df-46cb-b7f5-452ed7e4f030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:25 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Volume 212536a3-6d7c-4a42-9327-22bad94bd438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212536a3-6d7c-4a42-9327-22bad94bd438', 'volume_size': 1} Nov 03 17:14:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:26 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 1073741824" returned: 0 in 0.524s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:26 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 Nov 03 17:14:26 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:26 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42" returned: 0 in 0.271s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722509203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212536a3-6d7c-4a42-9327-22bad94bd438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74af5a9a46b4abe9ab42d688a3fe966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:26Z,use_quota=True,user_id='b99dbdc9577c41e49e2f13ce6e172ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Creating volume 212536a3-6d7c-4a42-9327-22bad94bd438 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:26 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:26 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 1073741824 Nov 03 17:14:26 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29d2c62-c70e-4102-bd8e-1e470a89142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3276f91d-8e82-498b-a412-482881842c42', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f7523e-5d75-4851-a6bd-4d37f6f97c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Lock "cinder-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:26 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Volume volume-3276f91d-8e82-498b-a412-482881842c42 (3276f91d-8e82-498b-a412-482881842c42): created successfully Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f7523e-5d75-4851-a6bd-4d37f6f97c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Flow 'volume_create_manager' (09fc68e3-2cbc-4eed-93ad-a6e6cb644698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:26 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5400aeda-2925-40a3-9794-56b8b10b0b59 tempest-SnapshotDependencyTests-1299033175 None] Created volume successfully. Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" acquired by "delete_volume" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9864f9d4-ffc2-4201-af11-9bd5dca8e11b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:26 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d Nov 03 17:14:26 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-5d3512f4-9e12-4f6d-81ec-901b02a0afe7-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Lock "cinder-5d3512f4-9e12-4f6d-81ec-901b02a0afe7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-57b0f761-c61f-48c9-bf28-89ac5d2197c5" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-57b0f761-c61f-48c9-bf28-89ac5d2197c5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-5d3512f4-9e12-4f6d-81ec-901b02a0afe7" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-5d3512f4-9e12-4f6d-81ec-901b02a0afe7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Deleting offline snapshot 5d3512f4-9e12-4f6d-81ec-901b02a0afe7 of volume 57b0f761-c61f-48c9-bf28-89ac5d2197c5 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] snapshot_file for this snap is: volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff96313-3dce-415c-b5aa-de4251885b93]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:27 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 1073741824" returned: 0 in 0.649s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:27 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 Nov 03 17:14:27 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:27 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" returned: 0 in 0.500s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:27 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 Nov 03 17:14:27 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:27 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d Nov 03 17:14:27 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:27 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438" returned: 0 in 0.317s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.060s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c7cbee-e4df-46cb-b7f5-452ed7e4f030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212536a3-6d7c-4a42-9327-22bad94bd438', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f321c7b6-a767-4326-a5bf-bdd9d0eb621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Creating offline snapshot 220cb33b-f7eb-4429-a17f-c9b4df987a80 of volume 3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:27 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7" returned: 0 in 0.586s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:27 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0b636-0854-4027-8be1-5e13b3c148fc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2605149-43a0-40cb-979d-6cdd9a2fbef0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:27 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Volume volume-212536a3-6d7c-4a42-9327-22bad94bd438 (212536a3-6d7c-4a42-9327-22bad94bd438): created successfully Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f321c7b6-a767-4326-a5bf-bdd9d0eb621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Flow 'volume_create_manager' (10036f0d-00e6-4b3d-bc3a-644c106411af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" returned: 0 in 0.412s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d" released by "delete_volume" :: held 1.015s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-74662ef4-a48d-4c80-9784-1c4f7ed33910 tempest-ProjectReaderTests-1893280482 None] Created volume successfully. Nov 03 17:14:27 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 Nov 03 17:14:27 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Created reservations ['0a2e6de2-cc06-46cb-a53c-6e7b9eba10a8', '27326c40-a4f2-4d84-98f5-e73f86d8e45a', '60ded1b9-4557-49d0-a3e6-051b3ef76424', 'f0477831-67c0-462a-aea4-8c7e8c02ca7d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:27 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 Nov 03 17:14:27 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:27 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:27 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:28 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42" returned: 0 in 0.539s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Acquiring lock "cinder-212536a3-6d7c-4a42-9327-22bad94bd438-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:28 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 1G Nov 03 17:14:28 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:28 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Lock "cinder-212536a3-6d7c-4a42-9327-22bad94bd438-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5" returned: 0 in 0.595s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:28 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 Nov 03 17:14:28 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Acquiring lock "cinder-quobyte-212536a3-6d7c-4a42-9327-22bad94bd438" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:28 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.394s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:28 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Lock "cinder-quobyte-212536a3-6d7c-4a42-9327-22bad94bd438" acquired by "delete_volume" :: waited 0.038s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-58c1ca59-7ab0-4e8c-b534-6b132ee00f39 tempest-ProjectMemberTests-864696047 None] Lock "cinder-a9fa7986-74ef-4e84-89c5-f1b9eb8d8e5d-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[633402a0-c744-45d3-9df4-8b10eab3ea61]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:28 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 Nov 03 17:14:28 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:28 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7" returned: 0 in 0.407s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:28 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7 Nov 03 17:14:28 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:28 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 1G" returned: 0 in 0.529s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3276f91d-8e82-498b-a412-482881842c42 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:28 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3276f91d-8e82-498b-a412-482881842c42 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 Nov 03 17:14:28 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:28 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438" returned: 0 in 0.438s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:28 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438 Nov 03 17:14:28 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:28 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5.5d3512f4-9e12-4f6d-81ec-901b02a0afe7" returned: 0 in 0.315s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-5d3512f4-9e12-4f6d-81ec-901b02a0afe7" released by "_delete_snapshot" :: held 2.046s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:28 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-57b0f761-c61f-48c9-bf28-89ac5d2197c5" released by "delete_snapshot" :: held 2.090s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:29 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3276f91d-8e82-498b-a412-482881842c42 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80" returned: 0 in 0.382s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:29 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 is being set with open permissions: ugo+rw Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:29 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 Nov 03 17:14:29 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:29 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-212536a3-6d7c-4a42-9327-22bad94bd438" returned: 0 in 0.356s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Lock "cinder-quobyte-212536a3-6d7c-4a42-9327-22bad94bd438" released by "delete_volume" :: held 0.854s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Created reservations ['35e973e0-2988-45f4-b084-34253bd9778d', '7b68ddae-5791-4ad4-b19d-5fdc1fbf2232', '2f2f463d-aec2-4746-9b2d-cfc38106f288', '451a2609-f8fa-4a2d-98ed-765bce3583cd'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Delete snapshot completed successfully. Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-753daea2-65ea-4648-9c57-938d3f44c0b0 tempest-ProjectReaderTests-782803858 None] Lock "cinder-5d3512f4-9e12-4f6d-81ec-901b02a0afe7-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Created reservations ['072e5864-fcb7-4790-ab2b-3d10861cf7c1', '61aac136-225d-4a7a-bf51-d77b957bbf0f', '5f4a27db-7837-4fc3-ad90-6baaa1ec98d1', '62c61183-5a82-4ee0-8ce9-efc780b111f9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:29 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80" returned: 0 in 0.374s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:29 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:29 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:29 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.info Nov 03 17:14:29 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (57bbc012-1451-4c62-81bc-3e2a8a75008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8342093f-c704-493d-be18-59ae43de50bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8342093f-c704-493d-be18-59ae43de50bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1532789184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884aa2bb-addd-4fb6-a657-e833a0fe10f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:29Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a19ea0-6d6c-4a3a-b6f4-b36c56185ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a19ea0-6d6c-4a3a-b6f4-b36c56185ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafbec3a-f3aa-4085-9010-7484cff77546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafbec3a-f3aa-4085-9010-7484cff77546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '884aa2bb-addd-4fb6-a657-e833a0fe10f3', 'volume_name': 'volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937d8846-c942-41c2-a375-d105310bd921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937d8846-c942-41c2-a375-d105310bd921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0c91f9-89d8-4966-a226-91627eafcbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:29 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Volume 884aa2bb-addd-4fb6-a657-e833a0fe10f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3', 'volume_size': 1} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:29 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.307s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:29 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Deleted volume successfully. Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05f62615-e619-468b-af8e-5b9b7479474f tempest-ProjectReaderTests-1893280482 None] Lock "cinder-212536a3-6d7c-4a42-9327-22bad94bd438-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:29 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.info" returned: 0 in 0.317s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:29 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.info is being set with open permissions: ugo+rw Nov 03 17:14:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:29 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.info Nov 03 17:14:29 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:30 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.info" returned: 0 in 0.253s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.532s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1532789184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884aa2bb-addd-4fb6-a657-e833a0fe10f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:29Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Creating volume 884aa2bb-addd-4fb6-a657-e833a0fe10f3 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:30 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:30 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 1073741824 Nov 03 17:14:30 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:30 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-dc893d4f-a822-4488-9550-15c7a1dc305a tempest-SnapshotDependencyTests-1299033175 None] Create snapshot completed successfully Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-57b0f761-c61f-48c9-bf28-89ac5d2197c5-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Lock "cinder-57b0f761-c61f-48c9-bf28-89ac5d2197c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-57b0f761-c61f-48c9-bf28-89ac5d2197c5" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-57b0f761-c61f-48c9-bf28-89ac5d2197c5" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a074976a-66e2-41a3-8ee6-a5e148bc6ca5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:30 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 Nov 03 17:14:30 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:30 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 1073741824" returned: 0 in 0.528s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:30 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 Nov 03 17:14:30 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:30 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5" returned: 0 in 0.451s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:30 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5 Nov 03 17:14:30 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:30 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:30 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Flow 'volume_create_manager' (5d4cd74f-6d63-4f28-ac57-90b233ca0b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df2d5e3-7769-4047-be50-90017a909829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df2d5e3-7769-4047-be50-90017a909829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243369181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1493607d-1bd1-4568-af1d-ea1d6319df79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74af5a9a46b4abe9ab42d688a3fe966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:31Z,use_quota=True,user_id='b99dbdc9577c41e49e2f13ce6e172ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7db1142-cfb1-4747-ae76-c795c58364fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7db1142-cfb1-4747-ae76-c795c58364fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217abdcf-7539-402a-baef-f322a5c70f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217abdcf-7539-402a-baef-f322a5c70f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1493607d-1bd1-4568-af1d-ea1d6319df79', 'volume_name': 'volume-1493607d-1bd1-4568-af1d-ea1d6319df79', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3362646e-ef1b-4de0-9fea-3de4e984a4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3362646e-ef1b-4de0-9fea-3de4e984a4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fa085d-cefd-49b9-82d1-6bfea3777f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Volume 1493607d-1bd1-4568-af1d-ea1d6319df79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1493607d-1bd1-4568-af1d-ea1d6319df79', 'volume_size': 1} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3" returned: 0 in 0.443s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243369181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1493607d-1bd1-4568-af1d-ea1d6319df79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74af5a9a46b4abe9ab42d688a3fe966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:31Z,use_quota=True,user_id='b99dbdc9577c41e49e2f13ce6e172ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Creating volume 1493607d-1bd1-4568-af1d-ea1d6319df79 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:31 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0c91f9-89d8-4966-a226-91627eafcbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d20464-f728-41fa-aaf7-681617aa9ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-57b0f761-c61f-48c9-bf28-89ac5d2197c5" returned: 0 in 0.446s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:31 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 1073741824 Nov 03 17:14:31 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-57b0f761-c61f-48c9-bf28-89ac5d2197c5" released by "delete_volume" :: held 0.989s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:31 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Volume volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 (884aa2bb-addd-4fb6-a657-e833a0fe10f3): created successfully Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d20464-f728-41fa-aaf7-681617aa9ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (57bbc012-1451-4c62-81bc-3e2a8a75008f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6d4f0787-bd89-49c6-ab5a-b2eba3ddc601 tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:14:31 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.446s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Created reservations ['5bcbbba9-c3d9-4d6f-9995-0a586b65b106', '143abeeb-29a4-495f-8811-19a5db2fff85', '279a4c08-c633-4df2-a7a4-0e0786e56e76', '923a6ae5-5151-43d5-9703-df54c21df7a5'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:31 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:31 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Flow 'volume_create_manager' (6c518648-8f60-4f3d-bc76-cb38a99f6b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9528968-5ca3-420f-89d5-462b2db89a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9528968-5ca3-420f-89d5-462b2db89a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7071b345-0d2c-47db-adc0-e89868f611fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d066873ded4475910513d84be72b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=220cb33b-f7eb-4429-a17f-c9b4df987a80,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:31Z,use_quota=True,user_id='465ebce1b1ed4a9380b2b7cc0a1cf21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed36c628-5a2c-4b34-b3fc-4e978329c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed36c628-5a2c-4b34-b3fc-4e978329c400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18701f3-1c9c-4d6a-96bd-b72d8036781a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18701f3-1c9c-4d6a-96bd-b72d8036781a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7071b345-0d2c-47db-adc0-e89868f611fe', 'volume_name': 'volume-7071b345-0d2c-47db-adc0-e89868f611fe', 'volume_size': 1, 'snapshot_id': '220cb33b-f7eb-4429-a17f-c9b4df987a80'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8455487c-37e5-4aa2-9bd4-96bbd714b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8455487c-37e5-4aa2-9bd4-96bbd714b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1d127f-ba7b-48ed-8c94-8b09044e151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:31 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Volume 7071b345-0d2c-47db-adc0-e89868f611fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7071b345-0d2c-47db-adc0-e89868f611fe', 'volume_size': 1, 'snapshot_id': '220cb33b-f7eb-4429-a17f-c9b4df987a80'} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:31 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 1073741824" returned: 0 in 0.623s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:31 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.315s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Deleted volume successfully. Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:31 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-24907744-a2d0-4b33-9d9f-8be87193ad05 tempest-ProjectReaderTests-782803858 None] Lock "cinder-57b0f761-c61f-48c9-bf28-89ac5d2197c5-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:31 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 Nov 03 17:14:31 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:32 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79" returned: 0 in 0.260s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.446s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-quobyte-220cb33b-f7eb-4429-a17f-c9b4df987a80-7071b345-0d2c-47db-adc0-e89868f611fe" by "_create_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fa085d-cefd-49b9-82d1-6bfea3777f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1493607d-1bd1-4568-af1d-ea1d6319df79', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdd8bf3-db8d-4a68-8131-ca8eef77ee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-220cb33b-f7eb-4429-a17f-c9b4df987a80-7071b345-0d2c-47db-adc0-e89868f611fe" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Creating volume 7071b345-0d2c-47db-adc0-e89868f611fe from snapshot 220cb33b-f7eb-4429-a17f-c9b4df987a80 {{(pid=86939) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-quobyte-7071b345-0d2c-47db-adc0-e89868f611fe" by "_copy_volume_from_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:32 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Volume volume-1493607d-1bd1-4568-af1d-ea1d6319df79 (1493607d-1bd1-4568-af1d-ea1d6319df79): created successfully Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdd8bf3-db8d-4a68-8131-ca8eef77ee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Flow 'volume_create_manager' (5d4cd74f-6d63-4f28-ac57-90b233ca0b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-7071b345-0d2c-47db-adc0-e89868f611fe" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] snapshot: 220cb33b-f7eb-4429-a17f-c9b4df987a80, volume: 7071b345-0d2c-47db-adc0-e89868f611fe, {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:14:32 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7b44bb2b-520e-46ba-93d5-3018cb95ee85 tempest-ProjectReaderTests-1893280482 None] Created volume successfully. Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9528f3-5e9c-40aa-9967-491c02015bda]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:32 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 Nov 03 17:14:32 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:32 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3276f91d-8e82-498b-a412-482881842c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[5160ac77-f463-43dc-9f32-715c61e5494a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:32 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 Nov 03 17:14:32 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (c1684a94-4a31-43c1-b9ef-550fe49264d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ed03b2-39ff-4d30-9e1d-078019e73533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ed03b2-39ff-4d30-9e1d-078019e73533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628324037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feab8e44-891f-4a36-8f00-f48ef40c1910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:33Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa679b23-a694-47f9-9ef2-03f9d94d050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:32 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa679b23-a694-47f9-9ef2-03f9d94d050c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff4f892-7848-43f3-bf40-05f5f123c338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff4f892-7848-43f3-bf40-05f5f123c338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feab8e44-891f-4a36-8f00-f48ef40c1910', 'volume_name': 'volume-feab8e44-891f-4a36-8f00-f48ef40c1910', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86d7f31-9ef8-466b-8dd3-be378cea2017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86d7f31-9ef8-466b-8dd3-be378cea2017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e6c9de-8d4a-4874-ade1-4c775f4495fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:33 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Volume feab8e44-891f-4a36-8f00-f48ef40c1910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feab8e44-891f-4a36-8f00-f48ef40c1910', 'volume_size': 1} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:33 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42" returned: 0 in 0.431s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Creating direct copy from snapshot {{(pid=86939) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.utils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Path /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe not found in is_blk_device check {{(pid=86939) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:33 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe Nov 03 17:14:33 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Acquiring lock "cinder-1493607d-1bd1-4568-af1d-ea1d6319df79-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Lock "cinder-1493607d-1bd1-4568-af1d-ea1d6319df79-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Acquiring lock "cinder-quobyte-1493607d-1bd1-4568-af1d-ea1d6319df79" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Lock "cinder-quobyte-1493607d-1bd1-4568-af1d-ea1d6319df79" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[558f5fe5-2039-4590-83b2-956de55ed6c0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:33 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 Nov 03 17:14:33 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:33 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79" returned: 0 in 0.539s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:33 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79 Nov 03 17:14:33 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:34 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-1493607d-1bd1-4568-af1d-ea1d6319df79" returned: 0 in 0.500s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Lock "cinder-quobyte-1493607d-1bd1-4568-af1d-ea1d6319df79" released by "delete_volume" :: held 1.108s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Created reservations ['3cb574b8-7b62-49c1-bab7-c6bc36fe07b2', '43cd99ef-522e-45c4-bd76-19814ca7e921', '850282f2-fef2-4096-a9f8-5e4a628da49d', '5881b361-2dc4-4836-99e0-0d6b23777313'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:34 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:34 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:34 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.437s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:34 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:34 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Deleted volume successfully. Nov 03 17:14:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-05bada64-a499-408c-b470-a743e5e8df8b tempest-ProjectReaderTests-1893280482 None] Lock "cinder-1493607d-1bd1-4568-af1d-ea1d6319df79-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:39 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe" returned: 0 in 6.843s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:39 devstack cinder-volume[86939]: DEBUG cinder.image.image_utils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Image conversion details: src /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe {{(pid=86939) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:14:39 devstack cinder-volume[86939]: INFO cinder.image.image_utils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Converted 1024.00 MB image at 149.63 MB/s Nov 03 17:14:39 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe is being set with open permissions: ugo+rw Nov 03 17:14:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:39 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe Nov 03 17:14:39 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:40 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe" returned: 0 in 0.239s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-7071b345-0d2c-47db-adc0-e89868f611fe" released by "_copy_volume_from_snapshot" :: held 8.028s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-220cb33b-f7eb-4429-a17f-c9b4df987a80-7071b345-0d2c-47db-adc0-e89868f611fe" released by "_create_volume_from_snapshot" :: held 8.104s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.137s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.391s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Creating offline snapshot 1df9fc02-d3f9-4685-b69c-78aacd65b341 of volume 884aa2bb-addd-4fb6-a657-e833a0fe10f3 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1d127f-ba7b-48ed-8c94-8b09044e151d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7071b345-0d2c-47db-adc0-e89868f611fe', 'volume_size': 1, 'snapshot_id': '220cb33b-f7eb-4429-a17f-c9b4df987a80'}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aafec11-81e0-4d4d-950f-34690113c60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c365deb-70bc-4ef5-8ae9-b65b87cdba59]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:40 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Volume volume-7071b345-0d2c-47db-adc0-e89868f611fe (7071b345-0d2c-47db-adc0-e89868f611fe): created successfully Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aafec11-81e0-4d4d-950f-34690113c60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Flow 'volume_create_manager' (6c518648-8f60-4f3d-bc76-cb38a99f6b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:40 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-721ea0ef-fa23-48ac-8856-f7656a6107ce tempest-SnapshotDependencyTests-1299033175 None] Created volume successfully. Nov 03 17:14:40 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 Nov 03 17:14:40 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:40 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3" returned: 0 in 0.361s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:40 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 1G Nov 03 17:14:40 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:41 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 1G" returned: 0 in 0.418s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:41 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 Nov 03 17:14:41 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-220cb33b-f7eb-4429-a17f-c9b4df987a80-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:41 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341" returned: 0 in 0.299s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:41 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 is being set with open permissions: ugo+rw Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-220cb33b-f7eb-4429-a17f-c9b4df987a80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-quobyte-3276f91d-8e82-498b-a412-482881842c42" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-3276f91d-8e82-498b-a412-482881842c42" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-quobyte-220cb33b-f7eb-4429-a17f-c9b4df987a80" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:41 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 Nov 03 17:14:41 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-220cb33b-f7eb-4429-a17f-c9b4df987a80" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Deleting offline snapshot 220cb33b-f7eb-4429-a17f-c9b4df987a80 of volume 3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] snapshot_file for this snap is: volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8912e2c6-838a-4738-a38d-20142c9d7f02]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:41 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 Nov 03 17:14:41 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:41 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341" returned: 0 in 0.286s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:41 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.info Nov 03 17:14:41 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:41 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80" returned: 0 in 0.391s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3276f91d-8e82-498b-a412-482881842c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b22979-9645-43de-a68b-2d165946dade]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:41 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.info" returned: 0 in 0.301s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:41 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.info is being set with open permissions: ugo+rw Nov 03 17:14:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:41 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.info Nov 03 17:14:41 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:42 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 Nov 03 17:14:42 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:42 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.info" returned: 0 in 0.245s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.228s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628324037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feab8e44-891f-4a36-8f00-f48ef40c1910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:33Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Creating volume feab8e44-891f-4a36-8f00-f48ef40c1910 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:42 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:42 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 1073741824 Nov 03 17:14:42 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-7509f42c-e764-468f-abde-82173a696e2c tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:14:42 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42" returned: 0 in 0.559s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:42 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 Nov 03 17:14:42 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:42 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 1073741824" returned: 0 in 0.449s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:42 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 Nov 03 17:14:42 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:42 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80" returned: 0 in 0.370s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:42 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80 Nov 03 17:14:42 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:43 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910" returned: 0 in 0.276s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e6c9de-8d4a-4874-ade1-4c775f4495fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feab8e44-891f-4a36-8f00-f48ef40c1910', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e64dd03-e64c-4852-b070-816620a96e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:43 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Volume volume-feab8e44-891f-4a36-8f00-f48ef40c1910 (feab8e44-891f-4a36-8f00-f48ef40c1910): created successfully Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e64dd03-e64c-4852-b070-816620a96e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (c1684a94-4a31-43c1-b9ef-550fe49264d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:43 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42.220cb33b-f7eb-4429-a17f-c9b4df987a80" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:43 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e9fd6af5-c781-4959-9473-7c67c0c640cb tempest-ProjectReaderTests-782803858 None] Created volume successfully. Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-220cb33b-f7eb-4429-a17f-c9b4df987a80" released by "_delete_snapshot" :: held 1.717s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-3276f91d-8e82-498b-a412-482881842c42" released by "delete_snapshot" :: held 1.741s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Created reservations ['e6442066-1eee-4f32-b518-adf181953cd4', '7dbef3b6-11c0-4cb3-9e27-dcc59298b13b', 'f298358d-50cd-46dd-8bf2-df74c7318a8b', 'd41c2fd0-2240-4a62-a873-8ab69d3715e9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:43 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Delete snapshot completed successfully. Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-510d6ffe-ed95-4753-8e2f-c659cf64504d tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-220cb33b-f7eb-4429-a17f-c9b4df987a80-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-1df9fc02-d3f9-4685-b69c-78aacd65b341-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Lock "cinder-1df9fc02-d3f9-4685-b69c-78aacd65b341-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-884aa2bb-addd-4fb6-a657-e833a0fe10f3" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-884aa2bb-addd-4fb6-a657-e833a0fe10f3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-1df9fc02-d3f9-4685-b69c-78aacd65b341" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-1df9fc02-d3f9-4685-b69c-78aacd65b341" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot 1df9fc02-d3f9-4685-b69c-78aacd65b341 of volume 884aa2bb-addd-4fb6-a657-e833a0fe10f3 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[29db08b0-ccf7-4d68-bda2-85c6a228634d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-3276f91d-8e82-498b-a412-482881842c42-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-3276f91d-8e82-498b-a412-482881842c42-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-quobyte-3276f91d-8e82-498b-a412-482881842c42" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-3276f91d-8e82-498b-a412-482881842c42" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:43 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 Nov 03 17:14:43 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e729c4d4-797e-4850-977d-93307cd0b009]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:43 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 Nov 03 17:14:43 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:43 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341" returned: 0 in 0.469s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:43 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf22dc9-54c8-42d2-892e-f081229b788c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Creating offline snapshot 532947a5-3387-4306-8126-d276b4ea6536 of volume feab8e44-891f-4a36-8f00-f48ef40c1910 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7878b641-db9c-408e-bcdf-226f2c22baed]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42" returned: 0 in 0.465s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 Nov 03 17:14:44 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42 Nov 03 17:14:44 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 Nov 03 17:14:44 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-3276f91d-8e82-498b-a412-482881842c42" returned: 0 in 0.262s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-3276f91d-8e82-498b-a412-482881842c42" released by "delete_volume" :: held 0.797s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:44 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3" returned: 0 in 0.417s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 Nov 03 17:14:44 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910" returned: 0 in 0.394s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 1G Nov 03 17:14:44 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Created reservations ['c5146ead-af94-4a1a-b79e-e35758720048', '540cc805-ee1b-44ae-80fe-cfc5a1ca8ce9', 'd6cb3cbf-c35b-4ec0-9c83-5975996e28f2', '8e90821d-ef83-448d-bbf5-d72230f950fd'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:44 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-7071b345-0d2c-47db-adc0-e89868f611fe-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-7071b345-0d2c-47db-adc0-e89868f611fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "cinder-quobyte-7071b345-0d2c-47db-adc0-e89868f611fe" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-7071b345-0d2c-47db-adc0-e89868f611fe" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[508f6e32-7655-435a-a8f7-9b51316e7bc2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341" returned: 0 in 0.449s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341 Nov 03 17:14:44 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.336s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:44 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Deleted volume successfully. Nov 03 17:14:44 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-4de7ec10-7ec9-48dd-8553-b3e8483b3ca2 tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-3276f91d-8e82-498b-a412-482881842c42-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:45 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe Nov 03 17:14:45 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 1G" returned: 0 in 0.554s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feab8e44-891f-4a36-8f00-f48ef40c1910 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feab8e44-891f-4a36-8f00-f48ef40c1910 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 Nov 03 17:14:45 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3.1df9fc02-d3f9-4685-b69c-78aacd65b341" returned: 0 in 0.310s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-1df9fc02-d3f9-4685-b69c-78aacd65b341" released by "_delete_snapshot" :: held 1.780s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-884aa2bb-addd-4fb6-a657-e833a0fe10f3" released by "delete_snapshot" :: held 1.807s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:45 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe" returned: 0 in 0.459s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Created reservations ['5c3aff49-38fc-4146-a40c-3dc25d48f7a5', '848b187a-a259-4806-b974-fc2c56d3f54f', '9c8b9124-84cd-4f56-9450-c0a9e84de2cc', 'f22909b3-2aef-4c87-8f68-8e2882024617'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:45 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe Nov 03 17:14:45 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feab8e44-891f-4a36-8f00-f48ef40c1910 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536" returned: 0 in 0.350s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 is being set with open permissions: ugo+rw Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 Nov 03 17:14:45 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e254edb8-c055-495b-896a-0233ff00d234 tempest-ProjectMemberTests-864696047 None] Lock "cinder-1df9fc02-d3f9-4685-b69c-78aacd65b341-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-884aa2bb-addd-4fb6-a657-e833a0fe10f3-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Lock "cinder-884aa2bb-addd-4fb6-a657-e833a0fe10f3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:45 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-7071b345-0d2c-47db-adc0-e89868f611fe" returned: 0 in 0.329s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-884aa2bb-addd-4fb6-a657-e833a0fe10f3" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-quobyte-7071b345-0d2c-47db-adc0-e89868f611fe" released by "delete_volume" :: held 0.842s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-884aa2bb-addd-4fb6-a657-e833a0fe10f3" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:45 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536" returned: 0 in 0.336s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c89a1ff-0b7a-491e-b60b-472487c43bfb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.info Nov 03 17:14:45 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Created reservations ['e66c96ab-abfd-40e3-8989-cedfd5ab131a', '1a3a515c-8909-4fd8-a159-1cf3665d2a24', '0017a59f-ee83-4151-9ba5-a4e43719cced', 'fa11aa9d-d961-4e37-9e0c-86e34845989e'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:45 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 Nov 03 17:14:45 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:45 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:45 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:46 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.info" returned: 0 in 0.353s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:46 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.info is being set with open permissions: ugo+rw Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:46 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.info Nov 03 17:14:46 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:46 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:46 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3" returned: 0 in 0.523s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.367s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Deleted volume successfully. Nov 03 17:14:46 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3 Nov 03 17:14:46 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ebb61a9a-00cc-4780-b651-ad15338fb491 tempest-SnapshotDependencyTests-1299033175 None] Lock "cinder-7071b345-0d2c-47db-adc0-e89868f611fe-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:46 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.info" returned: 0 in 0.308s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:46 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6c9836c1-1896-4ca8-8ed2-2502d3af2cd8 tempest-ProjectReaderTests-782803858 None] Create snapshot completed successfully Nov 03 17:14:46 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-884aa2bb-addd-4fb6-a657-e833a0fe10f3" returned: 0 in 0.276s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-884aa2bb-addd-4fb6-a657-e833a0fe10f3" released by "delete_volume" :: held 0.876s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Created reservations ['659eff26-08a1-4ca0-9128-8a85232fff16', 'bfb95473-51b0-4b93-a399-972aa5a09b67', '7ee9c463-f3f2-406c-909b-2af326628e99', '09731036-1b9f-4275-b29d-11e688cfe199'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:46 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:46 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:46 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:47 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.311s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:47 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ea8e4269-f2be-41ea-8543-ad442dbe8e6e tempest-ProjectMemberTests-864696047 None] Lock "cinder-884aa2bb-addd-4fb6-a657-e833a0fe10f3-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-532947a5-3387-4306-8126-d276b4ea6536-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Lock "cinder-532947a5-3387-4306-8126-d276b4ea6536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-feab8e44-891f-4a36-8f00-f48ef40c1910" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-feab8e44-891f-4a36-8f00-f48ef40c1910" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-532947a5-3387-4306-8126-d276b4ea6536" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-532947a5-3387-4306-8126-d276b4ea6536" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Deleting offline snapshot 532947a5-3387-4306-8126-d276b4ea6536 of volume feab8e44-891f-4a36-8f00-f48ef40c1910 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] snapshot_file for this snap is: volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e45d349-8d42-42d8-80c1-50782279d03e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:47 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 Nov 03 17:14:47 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (3372f316-5599-4933-a1e6-3c4404d3c2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6818e805-248b-48d2-8a52-b5b0a75c59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6818e805-248b-48d2-8a52-b5b0a75c59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029115152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd00fba3-92b2-4392-a09e-edfe5a061642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:47Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c7155d-b565-4d20-a01d-e329bc4f3bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c7155d-b565-4d20-a01d-e329bc4f3bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0518c15-fbed-433f-8df9-9c7058f8f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0518c15-fbed-433f-8df9-9c7058f8f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd00fba3-92b2-4392-a09e-edfe5a061642', 'volume_name': 'volume-bd00fba3-92b2-4392-a09e-edfe5a061642', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3deea60b-9540-45c2-8d8e-ad0eddb54500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3deea60b-9540-45c2-8d8e-ad0eddb54500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93acf7f-e46e-4cc2-b7c8-2baeb158cb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Volume bd00fba3-92b2-4392-a09e-edfe5a061642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd00fba3-92b2-4392-a09e-edfe5a061642', 'volume_size': 1} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029115152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd00fba3-92b2-4392-a09e-edfe5a061642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:47Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Creating volume bd00fba3-92b2-4392-a09e-edfe5a061642 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:47 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:47 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 1073741824 Nov 03 17:14:47 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:47 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536" returned: 0 in 0.528s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feab8e44-891f-4a36-8f00-f48ef40c1910(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef923594-3268-4980-b7ba-3a35fdba4691]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:47 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:48 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 Nov 03 17:14:48 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:48 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 1073741824" returned: 0 in 0.706s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:48 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 Nov 03 17:14:48 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:48 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910" returned: 0 in 0.511s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:48 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 Nov 03 17:14:48 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:48 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642" returned: 0 in 0.336s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93acf7f-e46e-4cc2-b7c8-2baeb158cb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd00fba3-92b2-4392-a09e-edfe5a061642', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acabfabd-cb8f-4235-a0aa-69d9d233245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:48 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Volume volume-bd00fba3-92b2-4392-a09e-edfe5a061642 (bd00fba3-92b2-4392-a09e-edfe5a061642): created successfully Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acabfabd-cb8f-4235-a0aa-69d9d233245c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (3372f316-5599-4933-a1e6-3c4404d3c2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:48 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9f7ad022-a7e0-4bc2-b739-b8429d164e91 tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:14:48 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536" returned: 0 in 0.436s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:48 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:48 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536 Nov 03 17:14:48 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:49 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910.532947a5-3387-4306-8126-d276b4ea6536" returned: 0 in 0.316s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-532947a5-3387-4306-8126-d276b4ea6536" released by "_delete_snapshot" :: held 1.989s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-feab8e44-891f-4a36-8f00-f48ef40c1910" released by "delete_snapshot" :: held 2.022s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Created reservations ['8b3f282c-1188-4616-b1d6-f32e6847e62c', 'c8dc7785-8e85-41cf-a215-8a595dd571c3', '45ce4f32-3ac8-41f0-8ae7-d638a858df95', 'cfd0fe63-ccfd-46e9-8dac-8164e25efcf7'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:49 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Delete snapshot completed successfully. Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-1852adfe-b869-49fc-9c50-ffbc123d1a6c tempest-ProjectReaderTests-782803858 None] Lock "cinder-532947a5-3387-4306-8126-d276b4ea6536-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Creating offline snapshot c38749c7-e194-49bc-a0b0-89c9daca4979 of volume bd00fba3-92b2-4392-a09e-edfe5a061642 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a024742-8dbd-4e5b-a855-849d320b4551]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:49 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:49 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 Nov 03 17:14:49 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:50 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642" returned: 0 in 0.404s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:50 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 1G Nov 03 17:14:50 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-feab8e44-891f-4a36-8f00-f48ef40c1910-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Lock "cinder-feab8e44-891f-4a36-8f00-f48ef40c1910-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-feab8e44-891f-4a36-8f00-f48ef40c1910" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-feab8e44-891f-4a36-8f00-f48ef40c1910" acquired by "delete_volume" :: waited 0.028s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2595a0f-a768-4ec6-ab38-d754e02d9785]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:50 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 Nov 03 17:14:50 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:50 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 1G" returned: 0 in 0.622s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:50 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd00fba3-92b2-4392-a09e-edfe5a061642 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:50 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd00fba3-92b2-4392-a09e-edfe5a061642 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 Nov 03 17:14:50 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:51 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910" returned: 0 in 0.537s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:51 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910 Nov 03 17:14:51 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:51 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd00fba3-92b2-4392-a09e-edfe5a061642 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979" returned: 0 in 0.402s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:51 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 is being set with open permissions: ugo+rw Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:51 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 Nov 03 17:14:51 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:51 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-feab8e44-891f-4a36-8f00-f48ef40c1910" returned: 0 in 0.316s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-feab8e44-891f-4a36-8f00-f48ef40c1910" released by "delete_volume" :: held 0.989s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Created reservations ['203fdf77-e740-4f59-b0ab-da0694023148', 'd701424f-b7d7-4fea-bf39-5e89e5521153', 'aed505e8-5e45-4f29-8790-751e72a15e95', 'b4b52af5-b0a2-43ae-a242-b46229430eb9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:51 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979" returned: 0 in 0.414s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:51 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:51 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.info Nov 03 17:14:51 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:51 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:51 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:52 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:52 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:52 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Deleted volume successfully. Nov 03 17:14:52 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:52 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fd6acc14-60a0-43e2-af62-ab35794437ca tempest-ProjectReaderTests-782803858 None] Lock "cinder-feab8e44-891f-4a36-8f00-f48ef40c1910-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.info" returned: 0 in 0.436s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:52 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.info is being set with open permissions: ugo+rw Nov 03 17:14:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:52 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.info Nov 03 17:14:52 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:52 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.info" returned: 0 in 0.282s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:52 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:52 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-a35c57bb-a58e-4f17-a135-f3620bb8bd1a tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-c38749c7-e194-49bc-a0b0-89c9daca4979-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Lock "cinder-c38749c7-e194-49bc-a0b0-89c9daca4979-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-bd00fba3-92b2-4392-a09e-edfe5a061642" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-bd00fba3-92b2-4392-a09e-edfe5a061642" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-c38749c7-e194-49bc-a0b0-89c9daca4979" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-c38749c7-e194-49bc-a0b0-89c9daca4979" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot c38749c7-e194-49bc-a0b0-89c9daca4979 of volume bd00fba3-92b2-4392-a09e-edfe5a061642 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f6d047-fa37-4e59-8154-4e03ba3937c7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:53 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 Nov 03 17:14:53 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (14e4fb9b-dc64-416d-8f58-e41e752ec502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db200f0-8646-4485-a9df-98da6f1a8c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db200f0-8646-4485-a9df-98da6f1a8c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717135258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be13ae55-7957-43ac-9aa4-a8910a9e4c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:53Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ce149c-f9cc-4f5e-9dc9-365f074095d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ce149c-f9cc-4f5e-9dc9-365f074095d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ad473a-e447-4775-88b0-2e5235604fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ad473a-e447-4775-88b0-2e5235604fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be13ae55-7957-43ac-9aa4-a8910a9e4c1d', 'volume_name': 'volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc67faa-b6de-41c4-8446-946f107e6519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc67faa-b6de-41c4-8446-946f107e6519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389427f4-b5aa-489e-9011-da16978362f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:53 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Volume be13ae55-7957-43ac-9aa4-a8910a9e4c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d', 'volume_size': 1} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717135258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be13ae55-7957-43ac-9aa4-a8910a9e4c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:53Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Creating volume be13ae55-7957-43ac-9aa4-a8910a9e4c1d {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:53 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:53 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d 1073741824 Nov 03 17:14:53 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:53 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979" returned: 0 in 0.424s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd00fba3-92b2-4392-a09e-edfe5a061642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[19724051-239d-418c-92e1-4d3c7b487d9a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:53 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:53 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 Nov 03 17:14:53 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:54 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d 1073741824" returned: 0 in 0.628s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:54 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642" returned: 0 in 0.518s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:54 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d Nov 03 17:14:54 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:54 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 Nov 03 17:14:54 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:54 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" returned: 0 in 0.277s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389427f4-b5aa-489e-9011-da16978362f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce879338-a85b-4b43-b3e4-448ab8775920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:54 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Volume volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d (be13ae55-7957-43ac-9aa4-a8910a9e4c1d): created successfully Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce879338-a85b-4b43-b3e4-448ab8775920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (14e4fb9b-dc64-416d-8f58-e41e752ec502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:54 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-4804f115-0aa2-4b84-b879-08aeca3fa03f tempest-ProjectReaderTests-782803858 None] Created volume successfully. Nov 03 17:14:54 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979" returned: 0 in 0.421s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:54 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979 Nov 03 17:14:54 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:54 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642.c38749c7-e194-49bc-a0b0-89c9daca4979" returned: 0 in 0.265s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-c38749c7-e194-49bc-a0b0-89c9daca4979" released by "_delete_snapshot" :: held 1.796s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:54 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-bd00fba3-92b2-4392-a09e-edfe5a061642" released by "delete_snapshot" :: held 1.825s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Created reservations ['5aa90c86-49d3-4d5f-a911-ae3a2a2bc79f', '24765589-a917-4d88-a338-fdbc4a1ddb0b', 'b44ee7af-e669-400b-8cc9-575d3241cdae', 'e0602f2b-7516-4550-ba3f-5ff8971a90d6'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:55 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-687326ec-14fd-4903-b89d-963f482c5932 tempest-ProjectMemberTests-864696047 None] Lock "cinder-c38749c7-e194-49bc-a0b0-89c9daca4979-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-bd00fba3-92b2-4392-a09e-edfe5a061642-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Lock "cinder-bd00fba3-92b2-4392-a09e-edfe5a061642-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-bd00fba3-92b2-4392-a09e-edfe5a061642" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-bd00fba3-92b2-4392-a09e-edfe5a061642" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ba2f43-e452-452a-8704-ef4652d5ac5b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:55 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 Nov 03 17:14:55 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Creating offline snapshot 80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed of volume be13ae55-7957-43ac-9aa4-a8910a9e4c1d {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ad0119-acb4-4a54-92b9-da40eaa4284d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:55 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642" returned: 0 in 0.415s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:55 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:55 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d Nov 03 17:14:55 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:55 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642 Nov 03 17:14:55 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:56 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-bd00fba3-92b2-4392-a09e-edfe5a061642" returned: 0 in 0.319s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-bd00fba3-92b2-4392-a09e-edfe5a061642" released by "delete_volume" :: held 0.826s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:56 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" returned: 0 in 0.489s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:56 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed 1G Nov 03 17:14:56 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Created reservations ['dea4bd72-ced9-4261-8513-0d2c8a69c83b', '8592f8b7-e861-41dc-9fa9-2821b5222638', 'b968a037-c690-4d05-b815-037c3abeb741', '8a8e7fee-f31e-4836-9a96-25842884dd9f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:56 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:14:56 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:56 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed 1G" returned: 0 in 0.607s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:56 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.351s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:56 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:14:56 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed Nov 03 17:14:56 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:56 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ede38666-f273-4f92-8ddf-bc062101d93a tempest-ProjectMemberTests-864696047 None] Lock "cinder-bd00fba3-92b2-4392-a09e-edfe5a061642-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:57 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed" returned: 0 in 0.425s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:57 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed is being set with open permissions: ugo+rw Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:57 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed Nov 03 17:14:57 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (f6889743-5443-4f0b-94ee-7fd829770e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49b7e4a-b82e-4f5e-8191-c8c883fe8f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49b7e4a-b82e-4f5e-8191-c8c883fe8f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225534093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804cc6df-67b0-4d96-acc6-8acb8d7791ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:57Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52563a91-576a-486d-85ce-b4ea1995a757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52563a91-576a-486d-85ce-b4ea1995a757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472073ae-0cc4-4188-b38e-d14e745bcf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472073ae-0cc4-4188-b38e-d14e745bcf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '804cc6df-67b0-4d96-acc6-8acb8d7791ef', 'volume_name': 'volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525bb10a-8377-4ca6-bded-7ef91ef7cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525bb10a-8377-4ca6-bded-7ef91ef7cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8c567e-36cc-4d5d-9a05-e82267dddecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:57 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Volume 804cc6df-67b0-4d96-acc6-8acb8d7791ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef', 'volume_size': 1} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:57 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed" returned: 0 in 0.295s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:57 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.info Nov 03 17:14:57 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:57 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.info" returned: 0 in 0.262s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:57 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.info is being set with open permissions: ugo+rw Nov 03 17:14:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:57 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.info Nov 03 17:14:57 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:58 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.info" returned: 0 in 0.283s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225534093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804cc6df-67b0-4d96-acc6-8acb8d7791ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:57Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Creating volume 804cc6df-67b0-4d96-acc6-8acb8d7791ef {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:58 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:58 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef 1073741824 Nov 03 17:14:58 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:58 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e05b30e4-8998-4853-b60d-741a2b5f8524 tempest-ProjectReaderTests-782803858 None] Create snapshot completed successfully Nov 03 17:14:58 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef 1073741824" returned: 0 in 0.491s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:58 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef Nov 03 17:14:58 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Lock "cinder-80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:58 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Deleting offline snapshot 80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed of volume be13ae55-7957-43ac-9aa4-a8910a9e4c1d {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] snapshot_file for this snap is: volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef" returned: 0 in 0.330s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[058042ae-4de2-409f-ae21-217a8e66fd13]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8c567e-36cc-4d5d-9a05-e82267dddecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba7d2b8-2f95-419b-9832-d3575cf3ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Volume volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef (804cc6df-67b0-4d96-acc6-8acb8d7791ef): created successfully Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba7d2b8-2f95-419b-9832-d3575cf3ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (f6889743-5443-4f0b-94ee-7fd829770e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e6eb2727-4cc1-435d-8a64-bcc1594c5b97 tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:14:59 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed Nov 03 17:14:59 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:59 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed" returned: 0 in 0.547s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6396bf61-029e-466e-bdca-5eaa20dcea51]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Creating offline snapshot 065458ab-aac4-4c2b-9e71-790c15b0dded of volume 804cc6df-67b0-4d96-acc6-8acb8d7791ef {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f16a3c-4fa0-493b-b2ca-290448d349c1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:59 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d Nov 03 17:14:59 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:59 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef Nov 03 17:14:59 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:00 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" returned: 0 in 0.441s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:00 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed Nov 03 17:15:00 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:00 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef" returned: 0 in 0.419s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:00 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded 1G Nov 03 17:15:00 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:00 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed" returned: 0 in 0.342s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:00 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed Nov 03 17:15:00 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:00 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded 1G" returned: 0 in 0.439s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:00 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded Nov 03 17:15:00 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:00 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d.80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed" returned: 0 in 0.258s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed" released by "_delete_snapshot" :: held 1.742s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" released by "delete_snapshot" :: held 1.765s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Created reservations ['676412b2-a296-4181-9d9a-63cae4a93094', 'db25c80f-75cd-4e1a-bdc5-8fd0dc758dcc', 'c56216bd-f5fe-44cf-82d4-39c8e765a2ae', '313bbd81-73fe-4035-928c-913c998dc228'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:00 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Delete snapshot completed successfully. Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f8c740ec-b744-48cc-a66f-663ff4b15b69 tempest-ProjectReaderTests-782803858 None] Lock "cinder-80fc3283-cc1d-4c10-bd96-5d7b5bc8d4ed-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:00 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded" returned: 0 in 0.327s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:00 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded is being set with open permissions: ugo+rw Nov 03 17:15:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:00 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded Nov 03 17:15:00 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-be13ae55-7957-43ac-9aa4-a8910a9e4c1d-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Lock "cinder-be13ae55-7957-43ac-9aa4-a8910a9e4c1d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:01 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded" returned: 0 in 0.287s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[046aae2f-d3c5-4045-bf86-a7cfe59ecf0f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:01 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.info Nov 03 17:15:01 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:01 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d Nov 03 17:15:01 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:01 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.info" returned: 0 in 0.266s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:01 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.info is being set with open permissions: ugo+rw Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:01 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.info Nov 03 17:15:01 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:01 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" returned: 0 in 0.393s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:01 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d Nov 03 17:15:01 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:01 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.info" returned: 0 in 0.262s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c6c7a325-6607-44c4-abb8-afc8e42f21be tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:15:01 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" returned: 0 in 0.269s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-be13ae55-7957-43ac-9aa4-a8910a9e4c1d" released by "delete_volume" :: held 0.730s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Created reservations ['bff3bfc2-41be-4cc8-b655-c7098b964326', 'f8b89265-7d56-4571-a746-66c10ae09e2e', '46bc311f-2207-426e-b5b0-a5bb0368e4c8', '3866ef2e-1012-4917-b52b-77ca1ef86d80'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:02 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:02 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:02 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:02 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Deleted volume successfully. Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-af4b867b-fcbc-4b04-92ce-faa677b6f453 tempest-ProjectReaderTests-782803858 None] Lock "cinder-be13ae55-7957-43ac-9aa4-a8910a9e4c1d-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-065458ab-aac4-4c2b-9e71-790c15b0dded-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Lock "cinder-065458ab-aac4-4c2b-9e71-790c15b0dded-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-804cc6df-67b0-4d96-acc6-8acb8d7791ef" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (005632a8-ed8d-4b36-8e6f-32b59ad0b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e48b0e-8846-4268-a440-9777aa246ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e48b0e-8846-4268-a440-9777aa246ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797908499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79702d56-3a61-41a2-8c9d-52da52c34444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:03Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420a8e66-fea3-431f-bb4b-0b7dcafc0da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420a8e66-fea3-431f-bb4b-0b7dcafc0da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b32e98-e99f-40d8-9e8a-4b14f9e174d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b32e98-e99f-40d8-9e8a-4b14f9e174d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79702d56-3a61-41a2-8c9d-52da52c34444', 'volume_name': 'volume-79702d56-3a61-41a2-8c9d-52da52c34444', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547f085b-7822-4878-8fec-f25ae7f451de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547f085b-7822-4878-8fec-f25ae7f451de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec6f831-4067-4d8b-aa04-82d015db8b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:02 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Volume 79702d56-3a61-41a2-8c9d-52da52c34444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79702d56-3a61-41a2-8c9d-52da52c34444', 'volume_size': 1} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797908499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79702d56-3a61-41a2-8c9d-52da52c34444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:03Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Creating volume 79702d56-3a61-41a2-8c9d-52da52c34444 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:02 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-804cc6df-67b0-4d96-acc6-8acb8d7791ef" acquired by "delete_snapshot" :: waited 0.114s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-065458ab-aac4-4c2b-9e71-790c15b0dded" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-065458ab-aac4-4c2b-9e71-790c15b0dded" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:02 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 1073741824 Nov 03 17:15:02 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot 065458ab-aac4-4c2b-9e71-790c15b0dded of volume 804cc6df-67b0-4d96-acc6-8acb8d7791ef {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e730221f-9aa8-41a1-a110-47b1e3d5de5e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:03 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded Nov 03 17:15:03 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:03 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded" returned: 0 in 0.445s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:03 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 1073741824" returned: 0 in 0.545s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbabe591-3721-4c1d-accc-2aa091df0a7f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:03 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 Nov 03 17:15:03 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:03 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef Nov 03 17:15:03 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:03 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444" returned: 0 in 0.295s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec6f831-4067-4d8b-aa04-82d015db8b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79702d56-3a61-41a2-8c9d-52da52c34444', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cef218-7e4d-442e-83a5-0424e4e75f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:03 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Volume volume-79702d56-3a61-41a2-8c9d-52da52c34444 (79702d56-3a61-41a2-8c9d-52da52c34444): created successfully Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cef218-7e4d-442e-83a5-0424e4e75f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (005632a8-ed8d-4b36-8e6f-32b59ad0b180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:03 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-cee8a531-09a6-4f67-bca5-0c6aaa838d1b tempest-ProjectReaderTests-782803858 None] Created volume successfully. Nov 03 17:15:03 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef" returned: 0 in 0.422s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:03 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:03 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded Nov 03 17:15:03 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:04 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded" returned: 0 in 0.349s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:04 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded Nov 03 17:15:04 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:04 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef.065458ab-aac4-4c2b-9e71-790c15b0dded" returned: 0 in 0.240s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-065458ab-aac4-4c2b-9e71-790c15b0dded" released by "_delete_snapshot" :: held 1.573s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-804cc6df-67b0-4d96-acc6-8acb8d7791ef" released by "delete_snapshot" :: held 1.601s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=167,cinder:UPDATE=211,cinder:DELETE=20,cinder:INSERT=53 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Created reservations ['7ae38de9-3330-4653-b39e-c2fe889d23b3', 'dd13afef-0ed8-4704-b3db-4cebbfa86e80', '770c9b6b-e348-48ea-bb6c-31152253250b', 'f482f795-6a23-47f1-9bc0-07098387dd5f'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:04 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e6d25363-bde4-4500-9019-2ef1156d4cec tempest-ProjectMemberTests-864696047 None] Lock "cinder-065458ab-aac4-4c2b-9e71-790c15b0dded-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-804cc6df-67b0-4d96-acc6-8acb8d7791ef-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Lock "cinder-804cc6df-67b0-4d96-acc6-8acb8d7791ef-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:04 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=208,cinder:SELECT=162,cinder:INSERT=59,cinder:DELETE=15 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-804cc6df-67b0-4d96-acc6-8acb8d7791ef" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Creating offline snapshot 03169363-9f4b-48fc-a3a9-2514da2f04a8 of volume 79702d56-3a61-41a2-8c9d-52da52c34444 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-804cc6df-67b0-4d96-acc6-8acb8d7791ef" acquired by "delete_volume" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45a49fa-2ecb-4016-8217-f783c84a7d79]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6c9b6a-35b7-4ec2-9ae4-8767c2320ff3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:05 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 Nov 03 17:15:05 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:05 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef Nov 03 17:15:05 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:05 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444" returned: 0 in 0.412s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:05 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef" returned: 0 in 0.408s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:05 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 1G Nov 03 17:15:05 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:05 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef Nov 03 17:15:05 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:05 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-804cc6df-67b0-4d96-acc6-8acb8d7791ef" returned: 0 in 0.274s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-804cc6df-67b0-4d96-acc6-8acb8d7791ef" released by "delete_volume" :: held 0.754s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Created reservations ['ef5aa85b-8201-49f7-9306-b240adc84a24', '8b27f24d-6337-423d-8acd-233e4f772157', 'c2ce15e0-b012-42c7-b8e6-8ebd3be0a25c', '87fc4fcc-dfba-402a-ab0d-799a957bf2b4'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:05 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:05 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:05 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 1G" returned: 0 in 0.493s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79702d56-3a61-41a2-8c9d-52da52c34444 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:06 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79702d56-3a61-41a2-8c9d-52da52c34444 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 Nov 03 17:15:06 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:06 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.302s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-838e133c-26b0-4e0a-9e92-ce6e5cb7387f tempest-ProjectMemberTests-864696047 None] Lock "cinder-804cc6df-67b0-4d96-acc6-8acb8d7791ef-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:06 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79702d56-3a61-41a2-8c9d-52da52c34444 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8" returned: 0 in 0.381s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:06 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 is being set with open permissions: ugo+rw Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:06 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 Nov 03 17:15:06 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:06 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (edc24d8a-0f57-4842-b766-158eded8fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3a603e-8b0f-4be9-b3e9-3c6cb6634c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:06 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.info Nov 03 17:15:06 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3a603e-8b0f-4be9-b3e9-3c6cb6634c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880475464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221d6a26-facd-45d9-b989-71881601d04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:07Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc9c610-4c8e-4669-b5a3-a096f23ad5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc9c610-4c8e-4669-b5a3-a096f23ad5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d0f520-85e0-403a-9845-db2475efc925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d0f520-85e0-403a-9845-db2475efc925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '221d6a26-facd-45d9-b989-71881601d04e', 'volume_name': 'volume-221d6a26-facd-45d9-b989-71881601d04e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266f998b-37c8-41ff-8ac1-ccc6f0c7a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266f998b-37c8-41ff-8ac1-ccc6f0c7a62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157d447a-cec1-48c5-af89-61053309aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:06 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Volume 221d6a26-facd-45d9-b989-71881601d04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-221d6a26-facd-45d9-b989-71881601d04e', 'volume_size': 1} Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:06 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.info" returned: 0 in 0.273s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:06 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.info is being set with open permissions: ugo+rw Nov 03 17:15:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:07 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.info Nov 03 17:15:07 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:07 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.info" returned: 0 in 0.263s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880475464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221d6a26-facd-45d9-b989-71881601d04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:07Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Creating volume 221d6a26-facd-45d9-b989-71881601d04e {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:07 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:07 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e 1073741824 Nov 03 17:15:07 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-25dc499e-33ab-43e8-80e5-290b09a9b025 tempest-ProjectReaderTests-782803858 None] Create snapshot completed successfully Nov 03 17:15:07 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e 1073741824" returned: 0 in 0.455s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:07 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e Nov 03 17:15:07 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:08 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e" returned: 0 in 0.260s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157d447a-cec1-48c5-af89-61053309aff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221d6a26-facd-45d9-b989-71881601d04e', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39eff1d-cbc8-420a-944d-f08be288284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:08 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Volume volume-221d6a26-facd-45d9-b989-71881601d04e (221d6a26-facd-45d9-b989-71881601d04e): created successfully Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39eff1d-cbc8-420a-944d-f08be288284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (edc24d8a-0f57-4842-b766-158eded8fab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:08 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-bf53cd01-18d6-4708-bab7-18367e6bab5b tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-03169363-9f4b-48fc-a3a9-2514da2f04a8-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Lock "cinder-03169363-9f4b-48fc-a3a9-2514da2f04a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-79702d56-3a61-41a2-8c9d-52da52c34444" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-79702d56-3a61-41a2-8c9d-52da52c34444" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-03169363-9f4b-48fc-a3a9-2514da2f04a8" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-03169363-9f4b-48fc-a3a9-2514da2f04a8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Deleting offline snapshot 03169363-9f4b-48fc-a3a9-2514da2f04a8 of volume 79702d56-3a61-41a2-8c9d-52da52c34444 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] snapshot_file for this snap is: volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f8a3e6-7bb6-475c-9c98-58c9c8deb495]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:08 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 Nov 03 17:15:08 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:08 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8" returned: 0 in 0.373s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79702d56-3a61-41a2-8c9d-52da52c34444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13f11ec-60ca-498a-a4db-02e75c25d03e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:08 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 Nov 03 17:15:08 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Creating offline snapshot 1d575aa8-7e20-4c3a-91d2-73e535c2d418 of volume 221d6a26-facd-45d9-b989-71881601d04e {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e0c9e2-2d41-4eed-b132-a0d38985b7ad]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:08 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444" returned: 0 in 0.423s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e Nov 03 17:15:09 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 Nov 03 17:15:09 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e" returned: 0 in 0.410s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 1G Nov 03 17:15:09 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8" returned: 0 in 0.359s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8 Nov 03 17:15:09 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444.03169363-9f4b-48fc-a3a9-2514da2f04a8" returned: 0 in 0.258s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-03169363-9f4b-48fc-a3a9-2514da2f04a8" released by "_delete_snapshot" :: held 1.521s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-79702d56-3a61-41a2-8c9d-52da52c34444" released by "delete_snapshot" :: held 1.543s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Created reservations ['e2864a92-d37e-4c98-8925-48be19f852b6', '2e9cc287-c920-4965-a5de-a7bd830554d8', 'd400b1ce-dc58-4e4d-a174-e1e015a1dd3f', '436b5675-77ae-4edf-a789-ff5cb0f46ad5'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:09 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 1G" returned: 0 in 0.458s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221d6a26-facd-45d9-b989-71881601d04e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221d6a26-facd-45d9-b989-71881601d04e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 Nov 03 17:15:09 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Delete snapshot completed successfully. Nov 03 17:15:09 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-b2456cc5-732b-418b-a9b2-3d4c4d2713e7 tempest-ProjectReaderTests-782803858 None] Lock "cinder-03169363-9f4b-48fc-a3a9-2514da2f04a8-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:10 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221d6a26-facd-45d9-b989-71881601d04e -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418" returned: 0 in 0.362s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:10 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 is being set with open permissions: ugo+rw Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:10 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 Nov 03 17:15:10 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-79702d56-3a61-41a2-8c9d-52da52c34444-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Lock "cinder-79702d56-3a61-41a2-8c9d-52da52c34444-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-79702d56-3a61-41a2-8c9d-52da52c34444" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-79702d56-3a61-41a2-8c9d-52da52c34444" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5afcdc-ec3d-4cb8-b5a3-e804a576af35]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:10 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418" returned: 0 in 0.373s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:10 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 Nov 03 17:15:10 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:10 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.info Nov 03 17:15:10 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:10 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.info" returned: 0 in 0.259s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:10 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.info is being set with open permissions: ugo+rw Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:10 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.info Nov 03 17:15:10 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:10 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444" returned: 0 in 0.426s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:10 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:10 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444 Nov 03 17:15:10 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:11 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.info" returned: 0 in 0.281s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:11 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-79702d56-3a61-41a2-8c9d-52da52c34444" returned: 0 in 0.286s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-eb3c2203-8bed-44b5-9f93-1204dcb38e12 tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-79702d56-3a61-41a2-8c9d-52da52c34444" released by "delete_volume" :: held 0.787s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Created reservations ['6ed178f3-ba51-47e6-b9f8-653f426d877a', 'd31b72e8-1242-41e2-a1f0-bc0d998c2d34', '02ad1d73-b10c-40ca-a514-ba6b6221c6d0', '426471d9-8e55-4b4e-bafb-463d194b38f2'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:11 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:11 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:11 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.274s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:11 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Deleted volume successfully. Nov 03 17:15:11 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5e369401-f7e1-4998-bca7-e2717e29b10d tempest-ProjectReaderTests-782803858 None] Lock "cinder-79702d56-3a61-41a2-8c9d-52da52c34444-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (02c35be2-7ec9-44f7-9e8d-fa431160db84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735bd8e4-18f6-44ec-81e8-8ebc339bd566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735bd8e4-18f6-44ec-81e8-8ebc339bd566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745348933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdb2d2d-f7e8-4e0e-adc9-90891564593b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:12Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1223ea22-3bc6-402b-9e95-30b3c13bc47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1223ea22-3bc6-402b-9e95-30b3c13bc47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b9e5b9-4aa8-4be3-aa7c-4e566aad6b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b9e5b9-4aa8-4be3-aa7c-4e566aad6b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cdb2d2d-f7e8-4e0e-adc9-90891564593b', 'volume_name': 'volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d86572-6aea-43e7-9d39-b980a12c1101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d86572-6aea-43e7-9d39-b980a12c1101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c84f200-52ac-4a38-8fcf-d6e2719e0342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:12 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Volume 4cdb2d2d-f7e8-4e0e-adc9-90891564593b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b', 'volume_size': 1} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745348933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdb2d2d-f7e8-4e0e-adc9-90891564593b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd88096b9f1c45a69ad89c227baed27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:12Z,use_quota=True,user_id='ad53bed838524d8794db566029b163bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Creating volume 4cdb2d2d-f7e8-4e0e-adc9-90891564593b {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:12 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:12 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b 1073741824 Nov 03 17:15:12 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-1d575aa8-7e20-4c3a-91d2-73e535c2d418-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Lock "cinder-1d575aa8-7e20-4c3a-91d2-73e535c2d418-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-221d6a26-facd-45d9-b989-71881601d04e" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-221d6a26-facd-45d9-b989-71881601d04e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-1d575aa8-7e20-4c3a-91d2-73e535c2d418" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-1d575aa8-7e20-4c3a-91d2-73e535c2d418" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot 1d575aa8-7e20-4c3a-91d2-73e535c2d418 of volume 221d6a26-facd-45d9-b989-71881601d04e {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b1cfbc-723a-468e-aa3e-51e8c7149e8c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:12 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 Nov 03 17:15:12 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:12 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b 1073741824" returned: 0 in 0.491s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:12 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418" returned: 0 in 0.411s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221d6a26-facd-45d9-b989-71881601d04e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:12 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b Nov 03 17:15:12 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2ab924-af82-49f7-b7f2-fb376c01fdd3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:12 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e Nov 03 17:15:12 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:12 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" returned: 0 in 0.297s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c84f200-52ac-4a38-8fcf-d6e2719e0342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:12 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d5e466-28f2-49c8-b1bc-29c1f30b8b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:13 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Volume volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b (4cdb2d2d-f7e8-4e0e-adc9-90891564593b): created successfully Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d5e466-28f2-49c8-b1bc-29c1f30b8b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Flow 'volume_create_manager' (02c35be2-7ec9-44f7-9e8d-fa431160db84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-daf35a50-bef2-4da6-9662-dea4de719274 tempest-ProjectReaderTests-782803858 None] Created volume successfully. Nov 03 17:15:13 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e" returned: 0 in 0.425s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:13 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 Nov 03 17:15:13 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:13 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418" returned: 0 in 0.348s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:13 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418 Nov 03 17:15:13 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:13 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e.1d575aa8-7e20-4c3a-91d2-73e535c2d418" returned: 0 in 0.248s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-1d575aa8-7e20-4c3a-91d2-73e535c2d418" released by "_delete_snapshot" :: held 1.547s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-221d6a26-facd-45d9-b989-71881601d04e" released by "delete_snapshot" :: held 1.572s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Created reservations ['f99689b8-030a-4cd5-bbc9-8b46a4d6e5c2', '3345e913-0342-4f74-9b55-29cb8c9dffb9', '92f4b6e8-9295-4bbc-beac-99f1c37820ea', '4ec881ce-6189-4bfc-91dd-e68fce644f16'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:13 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:15:13 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5562c770-bad6-474e-8555-09fa54532612 tempest-ProjectMemberTests-864696047 None] Lock "cinder-1d575aa8-7e20-4c3a-91d2-73e535c2d418-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Creating offline snapshot 2b67c857-f978-4e90-8a73-e14c75db86cc of volume 4cdb2d2d-f7e8-4e0e-adc9-90891564593b {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fac79c-4193-4362-98e1-adcb95c7c215]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-221d6a26-facd-45d9-b989-71881601d04e-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Lock "cinder-221d6a26-facd-45d9-b989-71881601d04e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-221d6a26-facd-45d9-b989-71881601d04e" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-221d6a26-facd-45d9-b989-71881601d04e" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:14 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b Nov 03 17:15:14 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2492d9-f6e9-4b20-827a-ee387fe5ccb7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:14 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e Nov 03 17:15:14 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:14 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" returned: 0 in 0.435s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:14 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc 1G Nov 03 17:15:14 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:14 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e" returned: 0 in 0.389s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:14 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:14 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e Nov 03 17:15:14 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:15 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-221d6a26-facd-45d9-b989-71881601d04e" returned: 0 in 0.285s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:15 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc 1G" returned: 0 in 0.436s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-221d6a26-facd-45d9-b989-71881601d04e" released by "delete_volume" :: held 0.762s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:15 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc Nov 03 17:15:15 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Created reservations ['f468344f-bca7-4a82-8215-25d9a268d6f3', 'bb4c0cca-723c-4050-b978-9c657f4d4b57', 'ea6d694c-9655-4aed-bf62-72e6e66a55ef', 'a856c83c-c585-443b-bdd5-72bc942c2c92'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:15 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:15 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:15 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc" returned: 0 in 0.354s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:15 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc is being set with open permissions: ugo+rw Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:15 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc Nov 03 17:15:15 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:15 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.284s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:15 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-99ae63c1-053f-4264-bb64-0cc04f8eace3 tempest-ProjectMemberTests-864696047 None] Lock "cinder-221d6a26-facd-45d9-b989-71881601d04e-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:15 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc" returned: 0 in 0.296s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:15 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:15 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.info Nov 03 17:15:15 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (7e5d243d-45c6-4c36-9c51-ee37201bb9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e456e9e-630d-412f-af88-07e385d86240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:16 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.info" returned: 0 in 0.294s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:16 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.info is being set with open permissions: ugo+rw Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e456e9e-630d-412f-af88-07e385d86240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809102080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b101eed2-13cb-4b7d-a689-77749c2d17ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:16Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:16 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.info Nov 03 17:15:16 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecc1bbe-b894-4f78-a3a5-e72f02b5ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecc1bbe-b894-4f78-a3a5-e72f02b5ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125de503-06ed-49b9-b6f1-4f41dfd4de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125de503-06ed-49b9-b6f1-4f41dfd4de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b101eed2-13cb-4b7d-a689-77749c2d17ca', 'volume_name': 'volume-b101eed2-13cb-4b7d-a689-77749c2d17ca', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260b246b-8fbb-4e81-a342-4ddb7761f9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260b246b-8fbb-4e81-a342-4ddb7761f9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907f3a4b-b7d7-4f10-a1c6-754464fea3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:16 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Volume b101eed2-13cb-4b7d-a689-77749c2d17ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b101eed2-13cb-4b7d-a689-77749c2d17ca', 'volume_size': 1} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:16 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.info" returned: 0 in 0.258s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809102080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b101eed2-13cb-4b7d-a689-77749c2d17ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:16Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Creating volume b101eed2-13cb-4b7d-a689-77749c2d17ca {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:16 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:16 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca 1073741824 Nov 03 17:15:16 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:16 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-2749717f-1382-4595-a9c4-932db227e458 tempest-ProjectReaderTests-782803858 None] Create snapshot completed successfully Nov 03 17:15:16 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca 1073741824" returned: 0 in 0.436s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:16 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:16 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca Nov 03 17:15:16 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:17 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca" returned: 0 in 0.257s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907f3a4b-b7d7-4f10-a1c6-754464fea3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b101eed2-13cb-4b7d-a689-77749c2d17ca', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d10b23-846f-4401-ba99-db88d6b598f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:17 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Volume volume-b101eed2-13cb-4b7d-a689-77749c2d17ca (b101eed2-13cb-4b7d-a689-77749c2d17ca): created successfully Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d10b23-846f-4401-ba99-db88d6b598f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (7e5d243d-45c6-4c36-9c51-ee37201bb9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:17 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-35d01561-2327-4a9c-8a17-2aeea448de62 tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-2b67c857-f978-4e90-8a73-e14c75db86cc-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Lock "cinder-2b67c857-f978-4e90-8a73-e14c75db86cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-2b67c857-f978-4e90-8a73-e14c75db86cc" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-2b67c857-f978-4e90-8a73-e14c75db86cc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Deleting offline snapshot 2b67c857-f978-4e90-8a73-e14c75db86cc of volume 4cdb2d2d-f7e8-4e0e-adc9-90891564593b {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] snapshot_file for this snap is: volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[c868fead-e352-4740-b206-ee144b296428]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:17 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc Nov 03 17:15:17 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:17 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc" returned: 0 in 0.391s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b2593-c010-41b7-98ea-5a8a10f90753]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:17 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:18 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b Nov 03 17:15:18 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:18 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" returned: 0 in 0.417s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:18 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc Nov 03 17:15:18 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Creating offline snapshot d78a8855-391a-4481-be8c-f0e5effd16a4 of volume b101eed2-13cb-4b7d-a689-77749c2d17ca {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c965b-1ae2-4dac-81b1-ad40031201f3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:18 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca Nov 03 17:15:18 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:18 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc" returned: 0 in 0.371s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:18 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc Nov 03 17:15:18 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:18 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca" returned: 0 in 0.418s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:18 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:18 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 1G Nov 03 17:15:18 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:19 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b.2b67c857-f978-4e90-8a73-e14c75db86cc" returned: 0 in 0.302s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-2b67c857-f978-4e90-8a73-e14c75db86cc" released by "_delete_snapshot" :: held 1.584s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" released by "delete_snapshot" :: held 1.614s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Created reservations ['b9ea7a49-5e56-4a08-92bb-8ce783e1c888', '733a0d80-a737-43a7-96c9-9f447bf62910', '1d27ff27-f1ef-40d0-851c-d330f65f65fc', 'a72a2dcf-2b41-4c96-817d-24e26b243845'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:19 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Delete snapshot completed successfully. Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-3c1efb64-a7e1-4b5b-ade0-401a58a3628d tempest-ProjectReaderTests-782803858 None] Lock "cinder-2b67c857-f978-4e90-8a73-e14c75db86cc-delete_snapshot" released by "delete_snapshot" :: held 1.798s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:19 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 1G" returned: 0 in 0.532s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b101eed2-13cb-4b7d-a689-77749c2d17ca -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:19 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b101eed2-13cb-4b7d-a689-77749c2d17ca -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 Nov 03 17:15:19 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-4cdb2d2d-f7e8-4e0e-adc9-90891564593b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Lock "cinder-4cdb2d2d-f7e8-4e0e-adc9-90891564593b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Acquiring lock "cinder-quobyte-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e47548-750b-4fbc-bc60-31f4c1cfa6fc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:19 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b101eed2-13cb-4b7d-a689-77749c2d17ca -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4" returned: 0 in 0.398s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:19 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 is being set with open permissions: ugo+rw Nov 03 17:15:19 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:19 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 Nov 03 17:15:19 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:19 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b Nov 03 17:15:19 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:20 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4" returned: 0 in 0.370s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:20 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.info Nov 03 17:15:20 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:20 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" returned: 0 in 0.519s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:20 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b Nov 03 17:15:20 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:20 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.info" returned: 0 in 0.331s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:20 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.info is being set with open permissions: ugo+rw Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:20 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.info Nov 03 17:15:20 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:20 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" returned: 0 in 0.316s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Lock "cinder-quobyte-4cdb2d2d-f7e8-4e0e-adc9-90891564593b" released by "delete_volume" :: held 0.907s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Created reservations ['fb296ba4-4eb7-4ead-a748-b595c02a3449', '2b5706f0-5115-4214-aa03-48632cdf065d', '505d9e45-714d-4300-abe0-ccfa8688a1cb', '2553747c-572d-4be9-9a85-8698bac1089d'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:20 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.info" returned: 0 in 0.324s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:20 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:20 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:20 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:20 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-9361bd1d-a8d6-4924-863e-0836f3f549ab tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:15:21 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.371s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:21 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Deleted volume successfully. Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ab2c1a7d-e2c1-4b77-ae88-b17ad7c52d83 tempest-ProjectReaderTests-782803858 None] Lock "cinder-4cdb2d2d-f7e8-4e0e-adc9-90891564593b-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-d78a8855-391a-4481-be8c-f0e5effd16a4-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Lock "cinder-d78a8855-391a-4481-be8c-f0e5effd16a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-b101eed2-13cb-4b7d-a689-77749c2d17ca" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-b101eed2-13cb-4b7d-a689-77749c2d17ca" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-d78a8855-391a-4481-be8c-f0e5effd16a4" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-d78a8855-391a-4481-be8c-f0e5effd16a4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot d78a8855-391a-4481-be8c-f0e5effd16a4 of volume b101eed2-13cb-4b7d-a689-77749c2d17ca {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bc8014-f015-4a33-8ce5-58cf4161daef]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:21 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:21 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 Nov 03 17:15:21 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:22 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4" returned: 0 in 0.425s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:22 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b101eed2-13cb-4b7d-a689-77749c2d17ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:22 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[99002d2b-77b8-4387-b666-b6e427e40ae7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:22 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca Nov 03 17:15:22 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:22 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca" returned: 0 in 0.417s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:22 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 Nov 03 17:15:22 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:22 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:22 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4" returned: 0 in 0.433s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:23 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4 Nov 03 17:15:23 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:23 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca.d78a8855-391a-4481-be8c-f0e5effd16a4" returned: 0 in 0.368s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-d78a8855-391a-4481-be8c-f0e5effd16a4" released by "_delete_snapshot" :: held 1.769s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-b101eed2-13cb-4b7d-a689-77749c2d17ca" released by "delete_snapshot" :: held 1.799s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Created reservations ['23bdafe3-ff8d-43f3-b7bb-807798aa6eb5', 'c49985fb-d3ec-4cc4-871a-ed0dded5b2c4', '4d27d4ca-f695-44b1-a005-2d367c3cd3f6', '668d3fcb-e393-4b38-acd3-c9857f48d571'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:23 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-951ff53d-aaa8-4e85-bbef-507da386276c tempest-ProjectMemberTests-864696047 None] Lock "cinder-d78a8855-391a-4481-be8c-f0e5effd16a4-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-b101eed2-13cb-4b7d-a689-77749c2d17ca-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Lock "cinder-b101eed2-13cb-4b7d-a689-77749c2d17ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-b101eed2-13cb-4b7d-a689-77749c2d17ca" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-b101eed2-13cb-4b7d-a689-77749c2d17ca" acquired by "delete_volume" :: waited 0.027s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[281613ba-7399-4bb4-ae6b-14dcc42c3d66]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:23 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:24 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca Nov 03 17:15:24 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:24 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca" returned: 0 in 0.515s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:24 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca Nov 03 17:15:24 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:24 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-b101eed2-13cb-4b7d-a689-77749c2d17ca" returned: 0 in 0.315s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-b101eed2-13cb-4b7d-a689-77749c2d17ca" released by "delete_volume" :: held 0.926s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Created reservations ['4cc874ee-5f50-4497-8a61-4640cd9513bd', 'a32e3314-3368-4683-81e1-2456ddb76c51', '0d589f60-f73f-48f1-9c10-f91502a6a59c', '157608ce-4bbb-400b-a240-bfa5e1b50800'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:24 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:25 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:25 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:25 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:25 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.343s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:25 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:25 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:15:25 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-e963398e-3504-4049-af92-c4771fcb49cb tempest-ProjectMemberTests-864696047 None] Lock "cinder-b101eed2-13cb-4b7d-a689-77749c2d17ca-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (c0aee26d-a6b8-4672-94af-5cb5614ff50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034e8d99-612c-4568-951a-e55ec3edae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034e8d99-612c-4568-951a-e55ec3edae45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-124536750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009d9bf2-195f-45a2-93d1-efe7f78c256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:27Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc01fab-e935-44df-a9f0-6be2500d8eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc01fab-e935-44df-a9f0-6be2500d8eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18e53f0-8200-45fa-9018-6350ba9121a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18e53f0-8200-45fa-9018-6350ba9121a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009d9bf2-195f-45a2-93d1-efe7f78c256b', 'volume_name': 'volume-009d9bf2-195f-45a2-93d1-efe7f78c256b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf00149-515c-4b5c-ba90-4e293fc5a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf00149-515c-4b5c-ba90-4e293fc5a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed6c2e3-2384-4b07-9744-8c0a7398ab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:26 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Volume 009d9bf2-195f-45a2-93d1-efe7f78c256b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009d9bf2-195f-45a2-93d1-efe7f78c256b', 'volume_size': 1} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-124536750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009d9bf2-195f-45a2-93d1-efe7f78c256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:27Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Creating volume 009d9bf2-195f-45a2-93d1-efe7f78c256b {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:26 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:15:26 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:26 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b 1073741824 Nov 03 17:15:26 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:27 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b 1073741824" returned: 0 in 0.652s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:27 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b Nov 03 17:15:27 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:27 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b" returned: 0 in 0.329s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed6c2e3-2384-4b07-9744-8c0a7398ab01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009d9bf2-195f-45a2-93d1-efe7f78c256b', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8374a529-7429-4f8a-8b76-8406f3a9f17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:27 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Volume volume-009d9bf2-195f-45a2-93d1-efe7f78c256b (009d9bf2-195f-45a2-93d1-efe7f78c256b): created successfully Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8374a529-7429-4f8a-8b76-8406f3a9f17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:27 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (c0aee26d-a6b8-4672-94af-5cb5614ff50c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:27 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-86f5362a-87cd-493d-952f-3267809a7ffb tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:15:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:28 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:28 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Creating offline snapshot 3af02de0-9602-4bb3-b6e3-a896d0033e7f of volume 009d9bf2-195f-45a2-93d1-efe7f78c256b {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:29 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4412068-b67d-4013-a59e-adbc732962e6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:29 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b Nov 03 17:15:29 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:29 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b" returned: 0 in 0.392s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:29 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f 1G Nov 03 17:15:29 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:29 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f 1G" returned: 0 in 0.488s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:29 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009d9bf2-195f-45a2-93d1-efe7f78c256b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:29 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009d9bf2-195f-45a2-93d1-efe7f78c256b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f Nov 03 17:15:29 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:30 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009d9bf2-195f-45a2-93d1-efe7f78c256b -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f" returned: 0 in 0.356s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:30 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f is being set with open permissions: ugo+rw Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:30 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f Nov 03 17:15:30 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:30 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f" returned: 0 in 0.258s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:30 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.info Nov 03 17:15:30 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:30 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.info" returned: 0 in 0.271s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:30 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.info is being set with open permissions: ugo+rw Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:30 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.info Nov 03 17:15:30 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:30 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:30 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:30 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:31 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.info" returned: 0 in 0.264s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:31 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-92a6ee66-6ef3-492b-b2ad-910d90155b9e tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:15:31 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:31 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.278s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:31 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:31 devstack cinder-volume[86939]: DEBUG oslo_service.periodic_task [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] Running periodic task VolumeManager._thread_info {{(pid=86939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:15:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread count: 28 {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:15:31 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-8aa4edbe-0c3c-4610-a9e7-6867f41821f9 None None] thread info: [<_MainThread(MainThread, started 130864628158592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-3af02de0-9602-4bb3-b6e3-a896d0033e7f-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Lock "cinder-3af02de0-9602-4bb3-b6e3-a896d0033e7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-009d9bf2-195f-45a2-93d1-efe7f78c256b" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-009d9bf2-195f-45a2-93d1-efe7f78c256b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-3af02de0-9602-4bb3-b6e3-a896d0033e7f" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-3af02de0-9602-4bb3-b6e3-a896d0033e7f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot 3af02de0-9602-4bb3-b6e3-a896d0033e7f of volume 009d9bf2-195f-45a2-93d1-efe7f78c256b {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d75b699-f781-4305-aa72-c2292c20c140]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:32 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f Nov 03 17:15:32 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:32 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f" returned: 0 in 0.369s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-009d9bf2-195f-45a2-93d1-efe7f78c256b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd057a6a-6d8b-4828-851c-f95635518365]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:32 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:32 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b Nov 03 17:15:32 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:33 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b" returned: 0 in 0.386s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:33 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f Nov 03 17:15:33 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:33 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f" returned: 0 in 0.403s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:33 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f Nov 03 17:15:33 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:33 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b.3af02de0-9602-4bb3-b6e3-a896d0033e7f" returned: 0 in 0.283s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-3af02de0-9602-4bb3-b6e3-a896d0033e7f" released by "_delete_snapshot" :: held 1.550s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-009d9bf2-195f-45a2-93d1-efe7f78c256b" released by "delete_snapshot" :: held 1.579s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Created reservations ['adda05e0-dce1-4d9f-8eeb-d778fd6c6c36', '3554b347-f9b5-41a1-b1ba-01306b5028fb', '037b533d-c7f4-47c4-9879-ff100946f444', '76d001bd-3037-4846-9333-c5eb4bd4fe0a'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:33 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:15:33 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-6637f424-d471-4188-b325-1b41202ecd0b tempest-ProjectMemberTests-864696047 None] Lock "cinder-3af02de0-9602-4bb3-b6e3-a896d0033e7f-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-009d9bf2-195f-45a2-93d1-efe7f78c256b-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Lock "cinder-009d9bf2-195f-45a2-93d1-efe7f78c256b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-009d9bf2-195f-45a2-93d1-efe7f78c256b" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:34 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-009d9bf2-195f-45a2-93d1-efe7f78c256b" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:34 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce51837f-1107-4c4c-a639-39dab967a915]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:34 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b Nov 03 17:15:34 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:34 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b" returned: 0 in 0.415s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:34 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:34 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b Nov 03 17:15:34 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:35 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-009d9bf2-195f-45a2-93d1-efe7f78c256b" returned: 0 in 0.255s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-009d9bf2-195f-45a2-93d1-efe7f78c256b" released by "delete_volume" :: held 0.771s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Created reservations ['35b8d23f-db63-4999-ae44-ba9ea0ea7ed2', 'fe26f420-bb4a-4286-b3c7-d719faa534c4', 'd7cfd9fd-4ae8-4996-bec5-b9aa2c96487a', '9fad893f-f286-420e-a0df-64d94f1908b2'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:35 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:35 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:35 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.265s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:35 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:15:35 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-aa3ea5ec-635d-47cd-9fbc-8f962c1fee53 tempest-ProjectMemberTests-864696047 None] Lock "cinder-009d9bf2-195f-45a2-93d1-efe7f78c256b-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (ae65138a-de4b-41f3-babc-ce2996d7f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b41e25-f934-467c-811b-6b42a2962f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b41e25-f934-467c-811b-6b42a2962f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506066430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76c8aea-0ca2-49a6-b668-9809b4f02660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:36Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec527df-867c-4877-82a7-ccc836c87670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec527df-867c-4877-82a7-ccc836c87670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008a5969-3a89-417f-b044-21f7fe0157e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008a5969-3a89-417f-b044-21f7fe0157e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76c8aea-0ca2-49a6-b668-9809b4f02660', 'volume_name': 'volume-a76c8aea-0ca2-49a6-b668-9809b4f02660', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a27e3b3-62dc-418a-a20d-93500f049e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a27e3b3-62dc-418a-a20d-93500f049e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26b921d-cfac-47ff-b5d6-af242a81ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:36 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Volume a76c8aea-0ca2-49a6-b668-9809b4f02660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76c8aea-0ca2-49a6-b668-9809b4f02660', 'volume_size': 1} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506066430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76c8aea-0ca2-49a6-b668-9809b4f02660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04cfc0a0e7d346a2b7fe0378a28da716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:36Z,use_quota=True,user_id='d597588299484bd6b25feb229d2bd1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Creating volume a76c8aea-0ca2-49a6-b668-9809b4f02660 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:36 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:36 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 1073741824 Nov 03 17:15:36 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:36 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 1073741824" returned: 0 in 0.436s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:36 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 Nov 03 17:15:36 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:36 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660" returned: 0 in 0.240s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26b921d-cfac-47ff-b5d6-af242a81ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76c8aea-0ca2-49a6-b668-9809b4f02660', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecd37fe-24e2-4f98-8e63-f4df1a875033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:36 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Volume volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 (a76c8aea-0ca2-49a6-b668-9809b4f02660): created successfully Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecd37fe-24e2-4f98-8e63-f4df1a875033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:36 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Flow 'volume_create_manager' (ae65138a-de4b-41f3-babc-ce2996d7f527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:36 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-bd8bb701-65c7-43a5-8a95-b0d01c988850 tempest-ProjectMemberTests-864696047 None] Created volume successfully. Nov 03 17:15:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:37 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Creating offline snapshot 9fdb8fb1-999a-47c1-bb72-416a7514ba44 of volume a76c8aea-0ca2-49a6-b668-9809b4f02660 {{(pid=86939) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:37 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[de90150e-d7fe-40c1-a4f0-4f319e4cb6c1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:37 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 Nov 03 17:15:37 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:37 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660" returned: 0 in 0.390s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:37 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 1G {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:37 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 1G Nov 03 17:15:37 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:38 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 1G" returned: 0 in 0.404s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:38 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 Nov 03 17:15:38 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:38 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 -F qcow2 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44" returned: 0 in 0.296s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:38 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 is being set with open permissions: ugo+rw Nov 03 17:15:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:38 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 Nov 03 17:15:38 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:38 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44" returned: 0 in 0.227s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:38 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.info Nov 03 17:15:38 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:38 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.info" returned: 0 in 0.245s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:38 devstack cinder-volume[86939]: WARNING cinder.volume.drivers.remotefs [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.info is being set with open permissions: ugo+rw Nov 03 17:15:38 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.info {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:38 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.info Nov 03 17:15:38 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:39 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.info" returned: 0 in 0.238s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:39 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-b46eca43-6f6c-4161-b9b6-feda5a6231c3 tempest-ProjectMemberTests-864696047 None] Create snapshot completed successfully Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-9fdb8fb1-999a-47c1-bb72-416a7514ba44-delete_snapshot" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Lock "cinder-9fdb8fb1-999a-47c1-bb72-416a7514ba44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-a76c8aea-0ca2-49a6-b668-9809b4f02660" by "delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-a76c8aea-0ca2-49a6-b668-9809b4f02660" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-9fdb8fb1-999a-47c1-bb72-416a7514ba44" by "_delete_snapshot" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-9fdb8fb1-999a-47c1-bb72-416a7514ba44" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Deleting offline snapshot 9fdb8fb1-999a-47c1-bb72-416a7514ba44 of volume a76c8aea-0ca2-49a6-b668-9809b4f02660 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] snapshot_file for this snap is: volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 {{(pid=86939) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[27003cb5-3899-43d2-9319-2fa8cff3d45a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:39 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:39 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 Nov 03 17:15:39 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:40 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44" returned: 0 in 0.387s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:40 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a76c8aea-0ca2-49a6-b668-9809b4f02660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86939) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:40 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92b7011-3857-41f7-8a61-232894fb43eb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:40 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 Nov 03 17:15:40 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:40 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660" returned: 0 in 0.370s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:40 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 Nov 03 17:15:40 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:40 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44" returned: 0 in 0.360s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:40 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:40 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44 Nov 03 17:15:40 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:41 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660.9fdb8fb1-999a-47c1-bb72-416a7514ba44" returned: 0 in 0.275s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-9fdb8fb1-999a-47c1-bb72-416a7514ba44" released by "_delete_snapshot" :: held 1.500s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-a76c8aea-0ca2-49a6-b668-9809b4f02660" released by "delete_snapshot" :: held 1.524s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Created reservations ['65b73a01-f885-47a8-97e8-5e3c12b69f0b', '3fe33c97-c59e-4c95-9b46-7ab25d24bb8d', 'df74492f-ecec-426a-96e0-d6535d857d56', '9b8db05b-5fb3-413a-82a1-86cfb625e7a9'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:41 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Delete snapshot completed successfully. Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-c1423ac6-b987-4c43-a024-794b10d35ed9 tempest-ProjectMemberTests-864696047 None] Lock "cinder-9fdb8fb1-999a-47c1-bb72-416a7514ba44-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-a76c8aea-0ca2-49a6-b668-9809b4f02660-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Lock "cinder-a76c8aea-0ca2-49a6-b668-9809b4f02660-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Acquiring lock "cinder-quobyte-a76c8aea-0ca2-49a6-b668-9809b4f02660" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-a76c8aea-0ca2-49a6-b668-9809b4f02660" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[595ab4c6-1d48-48d7-a696-2fcb4bc646a4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:41 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:41 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 Nov 03 17:15:41 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:42 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660" returned: 0 in 0.376s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:42 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660 Nov 03 17:15:42 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:42 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-a76c8aea-0ca2-49a6-b668-9809b4f02660" returned: 0 in 0.252s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Lock "cinder-quobyte-a76c8aea-0ca2-49a6-b668-9809b4f02660" released by "delete_volume" :: held 0.698s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Created reservations ['4d5cc025-99b2-4acd-a649-406e18287507', 'c2422465-6758-40d6-b382-892f859ffa47', '5f3a5052-5b67-4db8-8d1d-882b4e335027', 'a8b1a496-71d9-4619-b532-5d49c111dcb8'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:42 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:42 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:42 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.272s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:42 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Deleted volume successfully. Nov 03 17:15:42 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-fa3e934c-36ea-4bc5-a32a-0493d3ccf331 tempest-ProjectMemberTests-864696047 None] Lock "cinder-a76c8aea-0ca2-49a6-b668-9809b4f02660-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:52 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=86,cinder:INSERT=37,cinder:UPDATE=113,cinder:DELETE=9 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:15:52 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:INSERT=28,cinder:UPDATE=118,cinder:SELECT=91,cinder:DELETE=9 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Flow 'volume_create_manager' (a2cedd95-7a54-4a7a-9d81-b01d75b0097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5559e8-3684-464c-8984-61cc9c5f0330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5559e8-3684-464c-8984-61cc9c5f0330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-558126778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f91982-bc95-4c53-8e87-5c67dbd3e0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36d4dcc794868b254b1f2e7819e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:56Z,use_quota=True,user_id='fa8e07fe77484ef6ab2d4bc9f61fe8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22f3714-a7a1-499a-b49f-3e4aa36245c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22f3714-a7a1-499a-b49f-3e4aa36245c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4646cf-8d07-45d0-8b30-67a0b51836f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4646cf-8d07-45d0-8b30-67a0b51836f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f91982-bc95-4c53-8e87-5c67dbd3e0c3', 'volume_name': 'volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2388a7e-a424-4143-bbf0-183d6474551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2388a7e-a424-4143-bbf0-183d6474551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93739264-f2d3-48df-98ba-e1992bbede5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:56 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Volume 30f91982-bc95-4c53-8e87-5c67dbd3e0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3', 'volume_size': 1} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-558126778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f91982-bc95-4c53-8e87-5c67dbd3e0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36d4dcc794868b254b1f2e7819e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:56Z,use_quota=True,user_id='fa8e07fe77484ef6ab2d4bc9f61fe8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Creating volume 30f91982-bc95-4c53-8e87-5c67dbd3e0c3 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:56 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:56 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 1073741824 Nov 03 17:15:56 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:56 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 1073741824" returned: 0 in 0.464s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:56 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:56 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 Nov 03 17:15:56 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:57 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3" returned: 0 in 0.264s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93739264-f2d3-48df-98ba-e1992bbede5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800eb5ee-fdb6-4868-88c3-dc7f4a7cfb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:57 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Volume volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 (30f91982-bc95-4c53-8e87-5c67dbd3e0c3): created successfully Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800eb5ee-fdb6-4868-88c3-dc7f4a7cfb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Flow 'volume_create_manager' (a2cedd95-7a54-4a7a-9d81-b01d75b0097e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:57 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-e720b2c7-d6eb-4a2b-8295-1359f742bc0c tempest-ProjectReaderTests-462114788 None] Created volume successfully. Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Acquiring lock "cinder-30f91982-bc95-4c53-8e87-5c67dbd3e0c3-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Lock "cinder-30f91982-bc95-4c53-8e87-5c67dbd3e0c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Acquiring lock "cinder-quobyte-30f91982-bc95-4c53-8e87-5c67dbd3e0c3" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Lock "cinder-quobyte-30f91982-bc95-4c53-8e87-5c67dbd3e0c3" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa76beb-8767-44b2-ae3a-8c568a7318fd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:57 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 Nov 03 17:15:57 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:57 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3" returned: 0 in 0.404s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:57 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:57 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3 Nov 03 17:15:57 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:58 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-30f91982-bc95-4c53-8e87-5c67dbd3e0c3" returned: 0 in 0.289s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Lock "cinder-quobyte-30f91982-bc95-4c53-8e87-5c67dbd3e0c3" released by "delete_volume" :: held 0.740s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Created reservations ['f4d23580-ac70-4450-9f54-06cdd76f3f6f', '1dfb791b-d72e-445a-8115-2b1827ca96be', '4f59ce98-022a-478d-a470-7f022a46a1db', '4a4cfde7-6f98-40e4-a6e6-60519bf10ba4'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:58 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:15:58 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:58 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.265s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:58 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Deleted volume successfully. Nov 03 17:15:58 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-ff3da0a6-c282-4875-9a70-c09b45d85578 tempest-ProjectReaderTests-462114788 None] Lock "cinder-30f91982-bc95-4c53-8e87-5c67dbd3e0c3-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Flow 'volume_create_manager' (870e553b-35a7-4016-b723-d22508e624cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc1b569-aa4d-4e42-aa40-53f8cecc603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc1b569-aa4d-4e42-aa40-53f8cecc603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-495226053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aab9a78-fde0-46d0-a980-bb662900f27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36d4dcc794868b254b1f2e7819e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:59Z,use_quota=True,user_id='fa8e07fe77484ef6ab2d4bc9f61fe8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c007783-644f-4f0a-b826-4b34c525b409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c007783-644f-4f0a-b826-4b34c525b409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6b22bf-a4c4-4767-ab59-ad030260bc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6b22bf-a4c4-4767-ab59-ad030260bc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aab9a78-fde0-46d0-a980-bb662900f27a', 'volume_name': 'volume-4aab9a78-fde0-46d0-a980-bb662900f27a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6620b274-f0bf-47d3-9232-a6fdab42eb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6620b274-f0bf-47d3-9232-a6fdab42eb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d18da0d-8c8b-4d0d-98e4-3d480b536537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Volume 4aab9a78-fde0-46d0-a980-bb662900f27a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aab9a78-fde0-46d0-a980-bb662900f27a', 'volume_size': 1} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-495226053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aab9a78-fde0-46d0-a980-bb662900f27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36d4dcc794868b254b1f2e7819e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:59Z,use_quota=True,user_id='fa8e07fe77484ef6ab2d4bc9f61fe8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Creating volume 4aab9a78-fde0-46d0-a980-bb662900f27a {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:59 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:59 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a 1073741824 Nov 03 17:15:59 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:59 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a 1073741824" returned: 0 in 0.436s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:59 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a Nov 03 17:15:59 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:59 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a" returned: 0 in 0.244s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d18da0d-8c8b-4d0d-98e4-3d480b536537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aab9a78-fde0-46d0-a980-bb662900f27a', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a549c54-9a91-45ff-bcef-f54ab269ecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Volume volume-4aab9a78-fde0-46d0-a980-bb662900f27a (4aab9a78-fde0-46d0-a980-bb662900f27a): created successfully Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a549c54-9a91-45ff-bcef-f54ab269ecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Flow 'volume_create_manager' (870e553b-35a7-4016-b723-d22508e624cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:59 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5793344d-c535-4d32-87d7-3de163461036 tempest-ProjectReaderTests-462114788 None] Created volume successfully. Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Acquiring lock "cinder-4aab9a78-fde0-46d0-a980-bb662900f27a-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Lock "cinder-4aab9a78-fde0-46d0-a980-bb662900f27a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Acquiring lock "cinder-quobyte-4aab9a78-fde0-46d0-a980-bb662900f27a" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Lock "cinder-quobyte-4aab9a78-fde0-46d0-a980-bb662900f27a" acquired by "delete_volume" :: waited 0.021s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f82bbae-b5fb-4726-8e9f-598bc1295cc0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:00 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a Nov 03 17:16:00 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:00 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a" returned: 0 in 0.377s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:00 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a Nov 03 17:16:00 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:00 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-4aab9a78-fde0-46d0-a980-bb662900f27a" returned: 0 in 0.244s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Lock "cinder-quobyte-4aab9a78-fde0-46d0-a980-bb662900f27a" released by "delete_volume" :: held 0.664s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:00 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Created reservations ['34c2d234-4aee-4816-98a5-64fba1833c12', '84484a91-7ee3-4138-8f76-22fdd7e6cdab', '40cf49c8-66ce-49ea-a77d-0ac1068504aa', '47336963-8cae-4dcd-8d6e-7856c2d2e73c'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:01 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:16:01 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:01 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.259s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:01 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Deleted volume successfully. Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-624e2c59-6380-443e-9896-562aead694cb tempest-ProjectReaderTests-462114788 None] Lock "cinder-4aab9a78-fde0-46d0-a980-bb662900f27a-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Flow 'volume_create_manager' (27d8eeb1-7a89-4aaa-8c55-5eae5dbf7b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b971b2e6-f0d2-4c2b-8ab8-be477e0aa56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b971b2e6-f0d2-4c2b-8ab8-be477e0aa56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1737419852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91460c09-dcea-4d7f-929a-fabc5fc77946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36d4dcc794868b254b1f2e7819e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:02Z,use_quota=True,user_id='fa8e07fe77484ef6ab2d4bc9f61fe8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9807d56-2f70-422a-8350-ed53ec25d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9807d56-2f70-422a-8350-ed53ec25d598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2439545a-97ce-403d-bab2-763106d6dbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2439545a-97ce-403d-bab2-763106d6dbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91460c09-dcea-4d7f-929a-fabc5fc77946', 'volume_name': 'volume-91460c09-dcea-4d7f-929a-fabc5fc77946', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657ab2f4-b4da-4104-8b7d-c324556bf6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657ab2f4-b4da-4104-8b7d-c324556bf6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05818f72-0a4e-4e3c-9c62-6e467261702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Volume 91460c09-dcea-4d7f-929a-fabc5fc77946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91460c09-dcea-4d7f-929a-fabc5fc77946', 'volume_size': 1} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1737419852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91460c09-dcea-4d7f-929a-fabc5fc77946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36d4dcc794868b254b1f2e7819e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:02Z,use_quota=True,user_id='fa8e07fe77484ef6ab2d4bc9f61fe8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Creating volume 91460c09-dcea-4d7f-929a-fabc5fc77946 {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:01 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:16:01 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:01 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 1073741824 Nov 03 17:16:01 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:02 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 1073741824" returned: 0 in 0.503s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:02 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 Nov 03 17:16:02 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:02 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946" returned: 0 in 0.261s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05818f72-0a4e-4e3c-9c62-6e467261702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91460c09-dcea-4d7f-929a-fabc5fc77946', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cbf96d-bfac-4263-aed5-07ce33711630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:02 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Volume volume-91460c09-dcea-4d7f-929a-fabc5fc77946 (91460c09-dcea-4d7f-929a-fabc5fc77946): created successfully Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cbf96d-bfac-4263-aed5-07ce33711630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:02 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Flow 'volume_create_manager' (27d8eeb1-7a89-4aaa-8c55-5eae5dbf7b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:02 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-98ca88ad-0d9f-40fe-b5b8-236af1f3af38 tempest-ProjectReaderTests-462114788 None] Created volume successfully. Nov 03 17:16:03 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Acquiring lock "cinder-91460c09-dcea-4d7f-929a-fabc5fc77946-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Lock "cinder-91460c09-dcea-4d7f-929a-fabc5fc77946-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Acquiring lock "cinder-quobyte-91460c09-dcea-4d7f-929a-fabc5fc77946" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Lock "cinder-quobyte-91460c09-dcea-4d7f-929a-fabc5fc77946" acquired by "delete_volume" :: waited 0.020s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f17400-97ea-466e-a0b8-c6ce472e567d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 Nov 03 17:16:04 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:04 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946" returned: 0 in 0.412s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946 Nov 03 17:16:04 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:04 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-91460c09-dcea-4d7f-929a-fabc5fc77946" returned: 0 in 0.256s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Lock "cinder-quobyte-91460c09-dcea-4d7f-929a-fabc5fc77946" released by "delete_volume" :: held 0.726s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Created reservations ['4ff6d159-2c10-4af4-85d9-ca8b223acffc', 'ee0c2eb1-9414-4095-a1d3-5fa400e8e2e0', '394b9dcb-613b-4f6b-9bf2-53970ca1c966', '22257ad1-d689-41d4-b6ff-31ea5b7341a6'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:04 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:16:04 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:05 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.331s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:05 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Deleted volume successfully. Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-5b7a64bb-a483-4a05-a405-6ba53747dace tempest-ProjectReaderTests-462114788 None] Lock "cinder-91460c09-dcea-4d7f-929a-fabc5fc77946-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86939) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Flow 'volume_create_manager' (46d57f01-ada7-4034-94f3-092b06615f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2935729f-daee-490e-868f-468e1cf1669e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2935729f-daee-490e-868f-468e1cf1669e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-399389093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329c438e-b18b-4a00-822c-657fe76cca0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36d4dcc794868b254b1f2e7819e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:06Z,use_quota=True,user_id='fa8e07fe77484ef6ab2d4bc9f61fe8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddf50ed-6712-4ffb-b4f4-d413f667dfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddf50ed-6712-4ffb-b4f4-d413f667dfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb97932-52c8-4335-b17f-d7a04d71a42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb97932-52c8-4335-b17f-d7a04d71a42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329c438e-b18b-4a00-822c-657fe76cca0d', 'volume_name': 'volume-329c438e-b18b-4a00-822c-657fe76cca0d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c91b02d-5d6d-4b97-841f-55772e3d6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c91b02d-5d6d-4b97-841f-55772e3d6a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b931c53b-1e51-4f1b-97dd-576b84a61441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:05 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Volume 329c438e-b18b-4a00-822c-657fe76cca0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329c438e-b18b-4a00-822c-657fe76cca0d', 'volume_size': 1} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-399389093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329c438e-b18b-4a00-822c-657fe76cca0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c36d4dcc794868b254b1f2e7819e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:06Z,use_quota=True,user_id='fa8e07fe77484ef6ab2d4bc9f61fe8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc),volume_type_id=5fbf4b35-78ad-42b9-a6ca-0c18ec37a3dc)}" {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.remotefs [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Creating volume 329c438e-b18b-4a00-822c-657fe76cca0d {{(pid=86939) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Selected osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 as target Quobyte volume. {{(pid=86939) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:05 devstack cinder-volume[86939]: INFO cinder.volume.drivers.remotefs [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] casted to osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126 Nov 03 17:16:05 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d 1073741824 {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:05 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d 1073741824 Nov 03 17:16:05 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:06 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d 1073741824" returned: 0 in 0.455s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:06 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d Nov 03 17:16:06 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:06 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d" returned: 0 in 0.273s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'} {{(pid=86939) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b931c53b-1e51-4f1b-97dd-576b84a61441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329c438e-b18b-4a00-822c-657fe76cca0d', 'volume_size': 1}' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f046ae5e-cccd-4faa-bc4a-855aa387bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:06 devstack cinder-volume[86939]: INFO cinder.volume.flows.manager.create_volume [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Volume volume-329c438e-b18b-4a00-822c-657fe76cca0d (329c438e-b18b-4a00-822c-657fe76cca0d): created successfully Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f046ae5e-cccd-4faa-bc4a-855aa387bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86939) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Flow 'volume_create_manager' (46d57f01-ada7-4034-94f3-092b06615f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86939) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:06 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-6a2e7f34-a949-49f4-a4b1-597decd98726 tempest-ProjectReaderTests-462114788 None] Created volume successfully. Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Acquiring lock "cinder-329c438e-b18b-4a00-822c-657fe76cca0d-delete_volume" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Lock "cinder-329c438e-b18b-4a00-822c-657fe76cca0d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Acquiring lock "cinder-quobyte-329c438e-b18b-4a00-822c-657fe76cca0d" by "delete_volume" {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Lock "cinder-quobyte-329c438e-b18b-4a00-822c-657fe76cca0d" acquired by "delete_volume" :: waited 0.016s {{(pid=86939) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1979c8-8649-4ec1-af54-5df20c5f9e86]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:06 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:07 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d Nov 03 17:16:07 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:07 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d" returned: 0 in 0.390s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:07 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d Nov 03 17:16:07 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:07 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d/volume-329c438e-b18b-4a00-822c-657fe76cca0d" returned: 0 in 0.258s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Lock "cinder-quobyte-329c438e-b18b-4a00-822c-657fe76cca0d" released by "delete_volume" :: held 0.693s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG cinder.quota [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Created reservations ['fe5ae008-685d-42a9-8135-f2f3456a6d85', 'a5e223a0-02fd-4b85-9f7d-4ae79a71ad99', 'caef38b7-2d18-45f4-9dc4-9c342d48e70c', '09015de1-3475-4137-a3bd-3b0fa1224548'] {{(pid=86939) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126': None} {{(pid=86939) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG cinder.volume.drivers.quobyte [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-52d7d319-c4d8-48c9-aa94-51cba65a9126'] {{(pid=86939) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.lockutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86939) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:07 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d Nov 03 17:16:07 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:07 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG oslo_concurrency.processutils [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/737eb959cf0fa301a5a698c8e807fc5d" returned: 0 in 0.265s {{(pid=86939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:07 devstack cinder-volume[86939]: DEBUG cinder.manager [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Notifying Schedulers of capabilities ... {{(pid=86939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:07 devstack cinder-volume[86939]: INFO cinder.volume.manager [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Deleted volume successfully. Nov 03 17:16:08 devstack cinder-volume[86939]: DEBUG cinder.coordination [None req-f689ee37-7703-48d6-ae74-76c8a4c42457 tempest-ProjectReaderTests-462114788 None] Lock "cinder-329c438e-b18b-4a00-822c-657fe76cca0d-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86939) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:17 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:SELECT=28,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:16:17 devstack cinder-volume[86939]: DEBUG dbcounter [-] [86939] Writing DB stats cinder:UPDATE=47,cinder:SELECT=28,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}